2015-02-12 14:41:07,214 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-12 14:41:07,249 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-12 14:41:07,249 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.CoGroupFieldedPipesPlatformTest
2015-02-12 14:41:07,268 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-02-12 14:41:07,915 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-02-12 14:41:07,964 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(770)) - No KeyProvider found.
2015-02-12 14:41:07,992 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(782)) - fsLock is fair:true
2015-02-12 14:41:08,043 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-02-12 14:41:08,044 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(232)) - dfs.block.invalidate.limit=1000
2015-02-12 14:41:08,045 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(238)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2015-02-12 14:41:08,049 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2015-02-12 14:41:08,050 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2015 Feb 12 14:41:08
2015-02-12 14:41:08,053 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2015-02-12 14:41:08,053 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:08,057 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 672 MB = 13.4 MB
2015-02-12 14:41:08,058 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^21 = 2097152 entries
2015-02-12 14:41:08,073 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(356)) - dfs.block.access.token.enable=false
2015-02-12 14:41:08,074 INFO blockmanagement.BlockManager (BlockManager.java:<init>(341)) - defaultReplication = 3
2015-02-12 14:41:08,074 INFO blockmanagement.BlockManager (BlockManager.java:<init>(342)) - maxReplication = 512
2015-02-12 14:41:08,074 INFO blockmanagement.BlockManager (BlockManager.java:<init>(343)) - minReplication = 1
2015-02-12 14:41:08,075 INFO blockmanagement.BlockManager (BlockManager.java:<init>(344)) - maxReplicationStreams = 2
2015-02-12 14:41:08,075 INFO blockmanagement.BlockManager (BlockManager.java:<init>(345)) - shouldCheckForEnoughRacks = false
2015-02-12 14:41:08,075 INFO blockmanagement.BlockManager (BlockManager.java:<init>(346)) - replicationRecheckInterval = 3000
2015-02-12 14:41:08,076 INFO blockmanagement.BlockManager (BlockManager.java:<init>(347)) - encryptDataTransfer = false
2015-02-12 14:41:08,076 INFO blockmanagement.BlockManager (BlockManager.java:<init>(348)) - maxNumBlocksToLog = 1000
2015-02-12 14:41:08,085 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(803)) - fsOwner = soberoi (auth:SIMPLE)
2015-02-12 14:41:08,086 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(804)) - supergroup = supergroup
2015-02-12 14:41:08,086 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(805)) - isPermissionEnabled = true
2015-02-12 14:41:08,097 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(816)) - HA Enabled: false
2015-02-12 14:41:08,105 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(853)) - Append Enabled: true
2015-02-12 14:41:08,331 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2015-02-12 14:41:08,331 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:08,332 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 672 MB = 6.7 MB
2015-02-12 14:41:08,332 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^20 = 1048576 entries
2015-02-12 14:41:08,333 INFO namenode.NameNode (FSDirectory.java:<init>(232)) - Caching file names occuring more than 10 times
2015-02-12 14:41:08,340 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2015-02-12 14:41:08,340 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:08,341 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 672 MB = 1.7 MB
2015-02-12 14:41:08,341 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^18 = 262144 entries
2015-02-12 14:41:08,343 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5455)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-02-12 14:41:08,343 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5456)) - dfs.namenode.safemode.min.datanodes = 0
2015-02-12 14:41:08,343 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5457)) - dfs.namenode.safemode.extension = 0
2015-02-12 14:41:08,345 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(942)) - Retry cache on namenode is enabled
2015-02-12 14:41:08,345 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(950)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-02-12 14:41:08,347 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2015-02-12 14:41:08,348 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:08,348 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 672 MB = 206.4 KB
2015-02-12 14:41:08,348 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^15 = 32768 entries
2015-02-12 14:41:08,353 INFO namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2015-02-12 14:41:08,353 INFO namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2015-02-12 14:41:08,354 INFO namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2015-02-12 14:41:08,394 INFO namenode.FSImage (FSImage.java:format(145)) - Allocated new BlockPoolId: BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:08,405 INFO common.Storage (NNStorage.java:format(550)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1 has been successfully formatted.
2015-02-12 14:41:08,408 INFO common.Storage (NNStorage.java:format(550)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name2 has been successfully formatted.
2015-02-12 14:41:08,505 INFO namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(203)) - Going to retain 1 images with txid >= 0
2015-02-12 14:41:08,507 INFO namenode.NameNode (NameNode.java:createNameNode(1356)) - createNameNode []
2015-02-12 14:41:08,525 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-02-12 14:41:08,576 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(356)) - Scheduled snapshot period at 10 second(s).
2015-02-12 14:41:08,577 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:start(184)) - NameNode metrics system started
2015-02-12 14:41:08,580 INFO namenode.NameNode (NameNode.java:setClientNamenodeAddress(344)) - fs.defaultFS is hdfs://127.0.0.1:0
2015-02-12 14:41:08,655 INFO hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1681)) - Starting web server as: ${dfs.web.authentication.kerberos.principal}
2015-02-12 14:41:08,656 INFO hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1692)) - Starting Web-server for hdfs at: http://localhost:0
2015-02-12 14:41:08,697 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-02-12 14:41:08,701 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.namenode is not defined
2015-02-12 14:41:08,716 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:08,721 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-02-12 14:41:08,721 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:08,722 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:08,744 INFO http.HttpServer2 (NameNodeHttpServer.java:initWebHdfs(86)) - Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
2015-02-12 14:41:08,747 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 14:41:08,769 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50537
2015-02-12 14:41:08,770 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:08,811 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_50537_hdfs____r9rhxk/webapp
2015-02-12 14:41:09,072 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50537
2015-02-12 14:41:09,074 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(770)) - No KeyProvider found.
2015-02-12 14:41:09,074 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(782)) - fsLock is fair:true
2015-02-12 14:41:09,075 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(232)) - dfs.block.invalidate.limit=1000
2015-02-12 14:41:09,076 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(238)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2015-02-12 14:41:09,076 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2015-02-12 14:41:09,077 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2015 Feb 12 14:41:09
2015-02-12 14:41:09,077 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2015-02-12 14:41:09,078 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:09,078 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 672 MB = 13.4 MB
2015-02-12 14:41:09,079 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^21 = 2097152 entries
2015-02-12 14:41:09,080 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(356)) - dfs.block.access.token.enable=false
2015-02-12 14:41:09,081 INFO blockmanagement.BlockManager (BlockManager.java:<init>(341)) - defaultReplication = 3
2015-02-12 14:41:09,081 INFO blockmanagement.BlockManager (BlockManager.java:<init>(342)) - maxReplication = 512
2015-02-12 14:41:09,082 INFO blockmanagement.BlockManager (BlockManager.java:<init>(343)) - minReplication = 1
2015-02-12 14:41:09,082 INFO blockmanagement.BlockManager (BlockManager.java:<init>(344)) - maxReplicationStreams = 2
2015-02-12 14:41:09,083 INFO blockmanagement.BlockManager (BlockManager.java:<init>(345)) - shouldCheckForEnoughRacks = false
2015-02-12 14:41:09,083 INFO blockmanagement.BlockManager (BlockManager.java:<init>(346)) - replicationRecheckInterval = 3000
2015-02-12 14:41:09,083 INFO blockmanagement.BlockManager (BlockManager.java:<init>(347)) - encryptDataTransfer = false
2015-02-12 14:41:09,084 INFO blockmanagement.BlockManager (BlockManager.java:<init>(348)) - maxNumBlocksToLog = 1000
2015-02-12 14:41:09,084 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(803)) - fsOwner = soberoi (auth:SIMPLE)
2015-02-12 14:41:09,084 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(804)) - supergroup = supergroup
2015-02-12 14:41:09,085 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(805)) - isPermissionEnabled = true
2015-02-12 14:41:09,085 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(816)) - HA Enabled: false
2015-02-12 14:41:09,086 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(853)) - Append Enabled: true
2015-02-12 14:41:09,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2015-02-12 14:41:09,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:09,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 672 MB = 6.7 MB
2015-02-12 14:41:09,088 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^20 = 1048576 entries
2015-02-12 14:41:09,089 INFO namenode.NameNode (FSDirectory.java:<init>(232)) - Caching file names occuring more than 10 times
2015-02-12 14:41:09,089 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2015-02-12 14:41:09,089 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:09,090 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 672 MB = 1.7 MB
2015-02-12 14:41:09,090 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^18 = 262144 entries
2015-02-12 14:41:09,091 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5455)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-02-12 14:41:09,091 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5456)) - dfs.namenode.safemode.min.datanodes = 0
2015-02-12 14:41:09,091 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(5457)) - dfs.namenode.safemode.extension = 0
2015-02-12 14:41:09,091 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(942)) - Retry cache on namenode is enabled
2015-02-12 14:41:09,092 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(950)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-02-12 14:41:09,092 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2015-02-12 14:41:09,092 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:09,093 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 672 MB = 206.4 KB
2015-02-12 14:41:09,093 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^15 = 32768 entries
2015-02-12 14:41:09,095 INFO namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2015-02-12 14:41:09,095 INFO namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2015-02-12 14:41:09,096 INFO namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2015-02-12 14:41:09,098 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:09,100 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name2/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:09,103 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(337)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1/current
2015-02-12 14:41:09,103 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(337)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name2/current
2015-02-12 14:41:09,105 INFO namenode.FSImage (FSImage.java:loadFSImage(655)) - No edit log streams selected.
2015-02-12 14:41:09,120 INFO namenode.FSImageFormatPBINode (FSImageFormatPBINode.java:loadINodeSection(214)) - Loading 1 INodes.
2015-02-12 14:41:09,128 INFO namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:load(171)) - Loaded FSImage in 0 seconds.
2015-02-12 14:41:09,129 INFO namenode.FSImage (FSImage.java:loadFSImage(930)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-02-12 14:41:09,134 INFO namenode.FSNamesystem (FSNamesystem.java:loadFSImage(1011)) - Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
2015-02-12 14:41:09,135 INFO namenode.FSEditLog (FSEditLog.java:startLogSegment(1162)) - Starting log segment at 1
2015-02-12 14:41:09,196 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-02-12 14:41:09,197 INFO namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(742)) - Finished loading FSImage in 101 msecs
2015-02-12 14:41:09,366 INFO namenode.NameNode (NameNodeRpcServer.java:<init>(317)) - RPC server is binding to localhost:0
2015-02-12 14:41:09,373 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:09,383 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50538
2015-02-12 14:41:09,415 INFO namenode.NameNode (NameNode.java:initialize(595)) - Clients are to use localhost:50538 to access this namenode/service.
2015-02-12 14:41:09,418 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(6411)) - Registered FSNamesystemState MBean
2015-02-12 14:41:09,446 INFO namenode.LeaseManager (LeaseManager.java:getNumUnderConstructionBlocks(132)) - Number of blocks under construction: 0
2015-02-12 14:41:09,447 INFO namenode.LeaseManager (LeaseManager.java:getNumUnderConstructionBlocks(132)) - Number of blocks under construction: 0
2015-02-12 14:41:09,448 INFO namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(1194)) - initializing replication queues
2015-02-12 14:41:09,449 INFO hdfs.StateChange (FSNamesystem.java:leave(5529)) - STATE* Leaving safe mode after 0 secs
2015-02-12 14:41:09,450 INFO hdfs.StateChange (FSNamesystem.java:leave(5540)) - STATE* Network topology has 0 racks and 0 datanodes
2015-02-12 14:41:09,450 INFO hdfs.StateChange (FSNamesystem.java:leave(5543)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-02-12 14:41:09,453 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2557)) - Total number of blocks = 0
2015-02-12 14:41:09,453 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2558)) - Number of invalid blocks = 0
2015-02-12 14:41:09,453 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2559)) - Number of under-replicated blocks = 0
2015-02-12 14:41:09,454 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2560)) - Number of over-replicated blocks = 0
2015-02-12 14:41:09,454 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2562)) - Number of blocks being written = 0
2015-02-12 14:41:09,454 INFO hdfs.StateChange (BlockManager.java:processMisReplicatesAsync(2563)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 4 msec
2015-02-12 14:41:09,495 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:09,495 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50538: starting
2015-02-12 14:41:09,497 INFO namenode.NameNode (NameNode.java:startCommonServices(638)) - NameNode RPC up at: localhost/127.0.0.1:50538
2015-02-12 14:41:09,498 INFO namenode.FSNamesystem (FSNamesystem.java:startActiveServices(1121)) - Starting services required for active state
2015-02-12 14:41:09,503 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(160)) - Starting CacheReplicationMonitor with interval 30000 milliseconds
2015-02-12 14:41:09,503 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(173)) - Rescanning because of pending operations
2015-02-12 14:41:09,504 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:41:09,557 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2
2015-02-12 14:41:09,612 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 14:41:09,613 INFO datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 14:41:09,616 INFO datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 14:41:09,621 INFO datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:50539
2015-02-12 14:41:09,623 INFO datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 14:41:09,623 INFO datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 14:41:09,628 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 14:41:09,630 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:09,631 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 14:41:09,631 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:09,632 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:09,637 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 14:41:09,638 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50540
2015-02-12 14:41:09,639 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:09,643 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_50540_datanode____.fbo74z/webapp
2015-02-12 14:41:09,776 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50540
2015-02-12 14:41:09,778 INFO datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 14:41:09,779 INFO datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 14:41:09,791 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:09,791 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50541
2015-02-12 14:41:09,796 INFO datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:50541
2015-02-12 14:41:09,802 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 14:41:09,804 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 14:41:09,811 INFO datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:50538 starting to offer service
2015-02-12 14:41:09,818 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:09,834 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50541: starting
2015-02-12 14:41:09,837 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4
2015-02-12 14:41:09,888 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 14:41:09,889 INFO datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 14:41:09,891 INFO datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 14:41:09,893 INFO datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:50543
2015-02-12 14:41:09,893 INFO datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 14:41:09,894 INFO datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 14:41:09,898 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 14:41:09,900 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:09,901 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 14:41:09,902 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:09,902 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:09,904 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 14:41:09,905 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50544
2015-02-12 14:41:09,906 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:09,912 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_50544_datanode____.yqerz3/webapp
2015-02-12 14:41:10,075 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,075 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,076 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,107 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50544
2015-02-12 14:41:10,108 INFO datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 14:41:10,108 INFO datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 14:41:10,110 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:10,112 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50545
2015-02-12 14:41:10,133 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,133 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,134 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,134 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,134 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,135 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,136 INFO datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:50545
2015-02-12 14:41:10,136 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,137 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,137 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,148 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 14:41:10,149 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 14:41:10,151 INFO datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:50538 starting to offer service
2015-02-12 14:41:10,156 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:10,157 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,157 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,157 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,159 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50545: starting
2015-02-12 14:41:10,163 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 2 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6
2015-02-12 14:41:10,192 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,192 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,192 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,193 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,193 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,197 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,198 INFO datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=307259344;bpid=BP-1595598241-10.1.1.67-1423780868362;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=307259344;c=0;bpid=BP-1595598241-10.1.1.67-1423780868362;dnuuid=null
2015-02-12 14:41:10,199 INFO datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID ba4eb4c8-687e-4153-8eed-0696bee7a7e5
2015-02-12 14:41:10,217 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,218 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,218 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,218 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,218 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,219 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,220 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,221 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,221 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,232 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current
2015-02-12 14:41:10,234 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current, StorageType: DISK
2015-02-12 14:41:10,235 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current
2015-02-12 14:41:10,236 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current, StorageType: DISK
2015-02-12 14:41:10,241 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 14:41:10,248 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423798323248 with interval 21600000
2015-02-12 14:41:10,249 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,249 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current...
2015-02-12 14:41:10,250 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current...
2015-02-12 14:41:10,251 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 14:41:10,251 INFO datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 14:41:10,253 INFO datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 14:41:10,255 INFO datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:50546
2015-02-12 14:41:10,256 INFO datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 14:41:10,257 INFO datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 14:41:10,259 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 14:41:10,263 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:10,267 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 14:41:10,267 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:10,268 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:10,269 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current: 19ms
2015-02-12 14:41:10,269 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current: 19ms
2015-02-12 14:41:10,270 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 14:41:10,271 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50547
2015-02-12 14:41:10,271 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:10,274 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_50547_datanode____lqncdg/webapp
2015-02-12 14:41:10,286 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-1595598241-10.1.1.67-1423780868362: 37ms
2015-02-12 14:41:10,295 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current...
2015-02-12 14:41:10,296 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current: 0ms
2015-02-12 14:41:10,298 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current...
2015-02-12 14:41:10,298 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current: 0ms
2015-02-12 14:41:10,299 INFO impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 13ms
2015-02-12 14:41:10,301 INFO datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 beginning handshake with NN
2015-02-12 14:41:10,313 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) storage ba4eb4c8-687e-4153-8eed-0696bee7a7e5
2015-02-12 14:41:10,316 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,316 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,316 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,316 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,317 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,318 INFO net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:50539
2015-02-12 14:41:10,319 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,322 INFO datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=307259344;bpid=BP-1595598241-10.1.1.67-1423780868362;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=307259344;c=0;bpid=BP-1595598241-10.1.1.67-1423780868362;dnuuid=null
2015-02-12 14:41:10,324 INFO datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID 67a136b3-f1b1-484d-a4cc-f09c1babb01c
2015-02-12 14:41:10,325 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current
2015-02-12 14:41:10,325 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current, StorageType: DISK
2015-02-12 14:41:10,326 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current
2015-02-12 14:41:10,326 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current, StorageType: DISK
2015-02-12 14:41:10,326 INFO datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 successfully registered with NN
2015-02-12 14:41:10,326 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 14:41:10,326 INFO datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:50538 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 14:41:10,328 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423782791328 with interval 21600000
2015-02-12 14:41:10,328 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,330 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current...
2015-02-12 14:41:10,333 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current...
2015-02-12 14:41:10,340 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current: 9ms
2015-02-12 14:41:10,340 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current: 6ms
2015-02-12 14:41:10,341 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-1595598241-10.1.1.67-1423780868362: 13ms
2015-02-12 14:41:10,342 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current...
2015-02-12 14:41:10,342 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current: 0ms
2015-02-12 14:41:10,344 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current...
2015-02-12 14:41:10,344 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current: 0ms
2015-02-12 14:41:10,345 INFO impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 4ms
2015-02-12 14:41:10,345 INFO datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 beginning handshake with NN
2015-02-12 14:41:10,346 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) storage 67a136b3-f1b1-484d-a4cc-f09c1babb01c
2015-02-12 14:41:10,347 INFO net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:50543
2015-02-12 14:41:10,348 INFO datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 successfully registered with NN
2015-02-12 14:41:10,348 INFO datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:50538 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 14:41:10,378 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-174017f2-c859-4e46-aa9a-7591a896afc4 for DN 127.0.0.1:50543
2015-02-12 14:41:10,379 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3 for DN 127.0.0.1:50543
2015-02-12 14:41:10,379 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1 for DN 127.0.0.1:50539
2015-02-12 14:41:10,379 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-c6c5584e-4881-4868-83c9-6613fcde082c for DN 127.0.0.1:50539
2015-02-12 14:41:10,392 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid 67a136b3-f1b1-484d-a4cc-f09c1babb01c) service to localhost/127.0.0.1:50538 trying to claim ACTIVE state with txid=1
2015-02-12 14:41:10,392 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid 67a136b3-f1b1-484d-a4cc-f09c1babb01c) service to localhost/127.0.0.1:50538
2015-02-12 14:41:10,401 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,401 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3 node DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
2015-02-12 14:41:10,401 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-174017f2-c859-4e46-aa9a-7591a896afc4,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,401 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-174017f2-c859-4e46-aa9a-7591a896afc4 node DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 14:41:10,415 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid ba4eb4c8-687e-4153-8eed-0696bee7a7e5) service to localhost/127.0.0.1:50538 trying to claim ACTIVE state with txid=1
2015-02-12 14:41:10,416 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid ba4eb4c8-687e-4153-8eed-0696bee7a7e5) service to localhost/127.0.0.1:50538
2015-02-12 14:41:10,418 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,419 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1 node DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
2015-02-12 14:41:10,419 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-c6c5584e-4881-4868-83c9-6613fcde082c,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,419 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-c6c5584e-4881-4868-83c9-6613fcde082c node DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 14:41:10,426 INFO datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 2 msec to generate and 32 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@3990e5f0
2015-02-12 14:41:10,426 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,429 INFO datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 13 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@6dfd4209
2015-02-12 14:41:10,429 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,429 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 14:41:10,429 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 14:41:10,429 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:10,429 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:10,430 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 14:41:10,431 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries
2015-02-12 14:41:10,432 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,434 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 14:41:10,434 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries
2015-02-12 14:41:10,435 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,437 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1595598241-10.1.1.67-1423780868362 to blockPoolScannerMap, new size=1
2015-02-12 14:41:10,437 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1595598241-10.1.1.67-1423780868362 to blockPoolScannerMap, new size=1
2015-02-12 14:41:10,508 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50547
2015-02-12 14:41:10,509 INFO datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 14:41:10,509 INFO datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 14:41:10,510 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:10,521 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50548
2015-02-12 14:41:10,525 INFO datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:50548
2015-02-12 14:41:10,532 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 14:41:10,533 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 14:41:10,535 INFO datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:50538 starting to offer service
2015-02-12 14:41:10,537 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:10,540 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50548: starting
2015-02-12 14:41:10,540 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,541 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,541 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,545 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 3 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8
2015-02-12 14:41:10,595 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,596 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,596 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,597 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,600 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,601 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,606 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,606 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,606 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,614 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 14:41:10,615 INFO datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 14:41:10,615 INFO datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 14:41:10,616 INFO datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:50549
2015-02-12 14:41:10,616 INFO datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 14:41:10,616 INFO datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 14:41:10,619 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 14:41:10,620 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:10,621 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 14:41:10,621 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:10,622 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:10,624 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 14:41:10,625 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50550
2015-02-12 14:41:10,625 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:10,629 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_50550_datanode____.noo2o4/webapp
2015-02-12 14:41:10,661 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,662 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,662 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,662 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,662 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,664 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,665 INFO datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=307259344;bpid=BP-1595598241-10.1.1.67-1423780868362;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=307259344;c=0;bpid=BP-1595598241-10.1.1.67-1423780868362;dnuuid=null
2015-02-12 14:41:10,666 INFO datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID 3baae80f-cbbd-47e2-a819-a98ddd6106a2
2015-02-12 14:41:10,667 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current
2015-02-12 14:41:10,668 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current, StorageType: DISK
2015-02-12 14:41:10,668 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current
2015-02-12 14:41:10,668 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current, StorageType: DISK
2015-02-12 14:41:10,669 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 14:41:10,671 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423801662671 with interval 21600000
2015-02-12 14:41:10,671 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,673 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current...
2015-02-12 14:41:10,673 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current...
2015-02-12 14:41:10,685 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current: 12ms
2015-02-12 14:41:10,685 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current: 11ms
2015-02-12 14:41:10,685 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-1595598241-10.1.1.67-1423780868362: 13ms
2015-02-12 14:41:10,686 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current...
2015-02-12 14:41:10,686 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current: 0ms
2015-02-12 14:41:10,687 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current...
2015-02-12 14:41:10,688 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current: 0ms
2015-02-12 14:41:10,688 INFO impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 3ms
2015-02-12 14:41:10,689 INFO datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 beginning handshake with NN
2015-02-12 14:41:10,690 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) storage 3baae80f-cbbd-47e2-a819-a98ddd6106a2
2015-02-12 14:41:10,690 INFO net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:50546
2015-02-12 14:41:10,691 INFO datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 successfully registered with NN
2015-02-12 14:41:10,691 INFO datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:50538 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 14:41:10,693 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-d4e0df8e-c520-4092-9aef-0a330e538dfb for DN 127.0.0.1:50546
2015-02-12 14:41:10,693 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35 for DN 127.0.0.1:50546
2015-02-12 14:41:10,693 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid 3baae80f-cbbd-47e2-a819-a98ddd6106a2) service to localhost/127.0.0.1:50538 trying to claim ACTIVE state with txid=1
2015-02-12 14:41:10,693 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid 3baae80f-cbbd-47e2-a819-a98ddd6106a2) service to localhost/127.0.0.1:50538
2015-02-12 14:41:10,695 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-d4e0df8e-c520-4092-9aef-0a330e538dfb,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,695 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-d4e0df8e-c520-4092-9aef-0a330e538dfb node DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
2015-02-12 14:41:10,695 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,695 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35 node DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 14:41:10,696 INFO datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 2 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@27da0241
2015-02-12 14:41:10,696 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,697 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 14:41:10,697 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:10,697 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 14:41:10,697 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries
2015-02-12 14:41:10,699 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,700 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1595598241-10.1.1.67-1423780868362 to blockPoolScannerMap, new size=1
2015-02-12 14:41:10,817 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50550
2015-02-12 14:41:10,819 INFO datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 14:41:10,819 INFO datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 14:41:10,820 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:10,821 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50551
2015-02-12 14:41:10,824 INFO datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:50551
2015-02-12 14:41:10,829 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 14:41:10,829 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 14:41:10,831 INFO datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:50538 starting to offer service
2015-02-12 14:41:10,833 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:10,833 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50551: starting
2015-02-12 14:41:10,835 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,836 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,836 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,889 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,890 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,890 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,890 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,890 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,892 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,894 INFO common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 90715@Edinburgh.local
2015-02-12 14:41:10,894 INFO common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,894 INFO common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 14:41:10,945 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,946 INFO common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 14:41:10,946 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362 is not formatted for BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,946 INFO common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 14:41:10,946 INFO common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-1595598241-10.1.1.67-1423780868362 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current
2015-02-12 14:41:10,949 INFO common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 14:41:10,950 INFO datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=307259344;bpid=BP-1595598241-10.1.1.67-1423780868362;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=307259344;c=0;bpid=BP-1595598241-10.1.1.67-1423780868362;dnuuid=null
2015-02-12 14:41:10,951 INFO datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID 6b984cb2-71ab-460a-8cc1-517caf617de4
2015-02-12 14:41:10,953 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current
2015-02-12 14:41:10,953 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current, StorageType: DISK
2015-02-12 14:41:10,954 INFO impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current
2015-02-12 14:41:10,954 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current, StorageType: DISK
2015-02-12 14:41:10,955 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 14:41:10,957 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423781759957 with interval 21600000
2015-02-12 14:41:10,958 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,959 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current...
2015-02-12 14:41:10,959 INFO impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current...
2015-02-12 14:41:10,970 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current: 10ms
2015-02-12 14:41:10,970 INFO impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-1595598241-10.1.1.67-1423780868362 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current: 11ms
2015-02-12 14:41:10,971 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-1595598241-10.1.1.67-1423780868362: 13ms
2015-02-12 14:41:10,971 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current...
2015-02-12 14:41:10,972 INFO impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current...
2015-02-12 14:41:10,972 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current: 0ms
2015-02-12 14:41:10,972 INFO impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-1595598241-10.1.1.67-1423780868362 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current: 0ms
2015-02-12 14:41:10,973 INFO impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 2ms
2015-02-12 14:41:10,974 INFO datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 beginning handshake with NN
2015-02-12 14:41:10,975 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) storage 6b984cb2-71ab-460a-8cc1-517caf617de4
2015-02-12 14:41:10,976 INFO net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:50549
2015-02-12 14:41:10,977 INFO datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid null) service to localhost/127.0.0.1:50538 successfully registered with NN
2015-02-12 14:41:10,977 INFO datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:50538 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 14:41:10,979 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-51c1de92-0253-455c-bba7-ac03bcda9c17 for DN 127.0.0.1:50549
2015-02-12 14:41:10,979 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397 for DN 127.0.0.1:50549
2015-02-12 14:41:10,980 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid 6b984cb2-71ab-460a-8cc1-517caf617de4) service to localhost/127.0.0.1:50538 trying to claim ACTIVE state with txid=1
2015-02-12 14:41:10,980 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-1595598241-10.1.1.67-1423780868362 (Datanode Uuid 6b984cb2-71ab-460a-8cc1-517caf617de4) service to localhost/127.0.0.1:50538
2015-02-12 14:41:10,983 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,983 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397 node DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
2015-02-12 14:41:10,983 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-51c1de92-0253-455c-bba7-ac03bcda9c17,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 14:41:10,983 INFO BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-51c1de92-0253-455c-bba7-ac03bcda9c17 node DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 14:41:10,985 INFO datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 4 msecs for RPC and NN processing. Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@5f1750d9
2015-02-12 14:41:10,985 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,985 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 14:41:10,985 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit
2015-02-12 14:41:10,986 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 14:41:10,986 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries
2015-02-12 14:41:10,987 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1595598241-10.1.1.67-1423780868362
2015-02-12 14:41:10,988 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-1595598241-10.1.1.67-1423780868362 to blockPoolScannerMap, new size=1
2015-02-12 14:41:11,358 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2113)) - Cluster is active
2015-02-12 14:41:11,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:11,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:11,443 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:41:11,483 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001 src: /127.0.0.1:50554 dest: /127.0.0.1:50539
2015-02-12 14:41:11,494 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001 src: /127.0.0.1:50555 dest: /127.0.0.1:50546
2015-02-12 14:41:11,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001 src: /127.0.0.1:50556 dest: /127.0.0.1:50549
2015-02-12 14:41:11,540 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50556, dest: /127.0.0.1:50549, bytes: 498874, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001, duration: 30450000
2015-02-12 14:41:11,540 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:11,541 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50555, dest: /127.0.0.1:50546, bytes: 498874, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001, duration: 33452000
2015-02-12 14:41:11,542 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:11,545 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50554, dest: /127.0.0.1:50539, bytes: 498874, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001, duration: 35561000
2015-02-12 14:41:11,546 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:11,555 INFO namenode.FSNamesystem (FSNamesystem.java:checkFileProgress(3532)) - BLOCK* checkFileProgress: blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} has not reached minimal replication 1
2015-02-12 14:41:11,556 INFO namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2015-02-12 14:41:11,556 INFO namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2015-02-12 14:41:11,559 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 498874
2015-02-12 14:41:11,560 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741825_1001 size 498874
2015-02-12 14:41:11,560 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741825_1001 size 498874
2015-02-12 14:41:11,964 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:11,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=soberoi:supergroup:rwxr--r-- proto=rpc
2015-02-12 14:41:12,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:12,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:12,071 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:41:12,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002 src: /127.0.0.1:50557 dest: /127.0.0.1:50546
2015-02-12 14:41:12,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002 src: /127.0.0.1:50558 dest: /127.0.0.1:50549
2015-02-12 14:41:12,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002 src: /127.0.0.1:50559 dest: /127.0.0.1:50539
2015-02-12 14:41:12,084 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50559, dest: /127.0.0.1:50539, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002, duration: 5653000
2015-02-12 14:41:12,084 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:12,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:41:12,087 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50558, dest: /127.0.0.1:50549, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002, duration: 7613000
2015-02-12 14:41:12,087 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:12,089 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:12,090 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50557, dest: /127.0.0.1:50546, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002, duration: 10542000
2015-02-12 14:41:12,090 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:12,091 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:12,093 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:12,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=soberoi:supergroup:rwxr--r-- proto=rpc
2015-02-12 14:41:12,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging dst=null perm=null proto=rpc
2015-02-12 14:41:12,178 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(154)) - mkdir: hdfs://localhost:50538/tmp/hadoop-yarn/staging
2015-02-12 14:41:12,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:41:12,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:41:12,230 INFO conf.Configuration (Configuration.java:getConfResourceAsInputStream(2204)) - core-site.xml not found
2015-02-12 14:41:12,230 INFO security.Groups (Groups.java:refresh(202)) - clearing userToGroupsMap cache
2015-02-12 14:41:12,233 INFO conf.Configuration (Configuration.java:getConfResourceAsInputStream(2204)) - yarn-site.xml not found
2015-02-12 14:41:12,235 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
2015-02-12 14:41:12,258 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-02-12 14:41:12,262 INFO security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(76)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-02-12 14:41:12,270 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:<init>(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms
2015-02-12 14:41:12,279 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-02-12 14:41:12,286 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-02-12 14:41:12,286 INFO resourcemanager.ResourceManager (ResourceManager.java:createScheduler(268)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
2015-02-12 14:41:12,314 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-02-12 14:41:12,316 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-02-12 14:41:12,319 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-02-12 14:41:12,321 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-02-12 14:41:12,338 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - ResourceManager metrics system started (again)
2015-02-12 14:41:12,347 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-02-12 14:41:12,351 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-02-12 14:41:12,354 INFO resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-02-12 14:41:12,358 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,359 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,359 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,359 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,359 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,359 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,360 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,360 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,360 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,360 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 14:41:12,362 INFO util.HostsFileReader (HostsFileReader.java:refresh(129)) - Refreshing hosts (include/exclude) list
2015-02-12 14:41:12,388 WARN fair.AllocationFileLoaderService (AllocationFileLoaderService.java:getAllocationFile(179)) - fair-scheduler.xml not found on the classpath.
2015-02-12 14:41:12,391 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$1
2015-02-12 14:41:12,391 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-02-12 14:41:12,392 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-02-12 14:41:12,392 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-02-12 14:41:12,392 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-02-12 14:41:12,392 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-02-12 14:41:12,393 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-02-12 14:41:12,393 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-02-12 14:41:12,393 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-02-12 14:41:12,394 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 0
2015-02-12 14:41:12,454 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 14:41:12,456 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 14:41:12,457 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 14:41:12,459 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 14:41:12,460 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 14:41:12,460 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 14:41:12,464 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 14:41:12,466 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 14:41:12,466 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 14:41:12,478 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 14:41:12,478 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 14:41:12,695 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 14:41:12,711 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 14:41:12,712 INFO containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 14:41:12,738 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) - Using ResourceCalculatorPlugin : null
2015-02-12 14:41:12,738 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) - Using ResourceCalculatorProcessTree : null
2015-02-12 14:41:12,739 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 14:41:12,739 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 14:41:12,740 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 14:41:12,740 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-02-12 14:41:12,740 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-02-12 14:41:12,741 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-02-12 14:41:12,741 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-02-12 14:41:12,741 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-02-12 14:41:12,742 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-02-12 14:41:12,742 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-02-12 14:41:12,743 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-02-12 14:41:12,743 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 1
2015-02-12 14:41:12,762 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 14:41:12,763 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 14:41:12,763 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 14:41:12,763 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 14:41:12,763 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 14:41:12,763 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 14:41:12,764 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 14:41:12,764 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 14:41:12,764 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 14:41:12,768 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 14:41:12,768 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 14:41:12,976 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 14:41:12,977 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 14:41:12,977 INFO containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 14:41:12,979 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) - Using ResourceCalculatorPlugin : null
2015-02-12 14:41:12,980 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) - Using ResourceCalculatorProcessTree : null
2015-02-12 14:41:12,980 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 14:41:12,980 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 14:41:12,980 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 14:41:12,981 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-02-12 14:41:12,981 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-02-12 14:41:12,982 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-02-12 14:41:12,982 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-02-12 14:41:12,982 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-02-12 14:41:12,982 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-02-12 14:41:12,983 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-02-12 14:41:12,983 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-02-12 14:41:12,985 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 2
2015-02-12 14:41:12,996 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 14:41:12,996 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 14:41:12,997 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 14:41:12,997 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 14:41:12,997 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 14:41:12,997 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 14:41:12,997 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 14:41:12,997 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 14:41:12,998 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 14:41:13,000 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 14:41:13,001 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 14:41:13,195 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 14:41:13,197 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 14:41:13,197 INFO containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 14:41:13,199 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) - Using ResourceCalculatorPlugin : null
2015-02-12 14:41:13,199 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) - Using ResourceCalculatorProcessTree : null
2015-02-12 14:41:13,200 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 14:41:13,201 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 14:41:13,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 14:41:13,202 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-02-12 14:41:13,202 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-02-12 14:41:13,202 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-02-12 14:41:13,203 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-02-12 14:41:13,203 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-02-12 14:41:13,203 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-02-12 14:41:13,203 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-02-12 14:41:13,204 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-02-12 14:41:13,204 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 3
2015-02-12 14:41:13,215 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 14:41:13,215 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 14:41:13,215 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 14:41:13,216 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 14:41:13,216 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 14:41:13,216 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 14:41:13,216 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 14:41:13,216 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 14:41:13,217 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 14:41:13,219 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 14:41:13,220 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 14:41:13,418 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 14:41:13,420 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 14:41:13,420 INFO containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 14:41:13,422 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) - Using ResourceCalculatorPlugin : null
2015-02-12 14:41:13,423 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) - Using ResourceCalculatorProcessTree : null
2015-02-12 14:41:13,423 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 14:41:13,423 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 14:41:13,423 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 14:41:13,438 INFO hs.JobHistory (JobHistory.java:serviceInit(83)) - JobHistory Init
2015-02-12 14:41:13,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null proto=rpc
2015-02-12 14:41:13,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:41:13,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:41:13,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:41:13,459 INFO hs.HistoryFileManager (HistoryFileManager.java:mkdir(645)) - Perms after creating 511, Expected: 1023
2015-02-12 14:41:13,459 INFO hs.HistoryFileManager (HistoryFileManager.java:mkdir(648)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-02-12 14:41:13,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=soberoi:supergroup:rwxrwxrwt proto=rpc
2015-02-12 14:41:20,262 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002
2015-02-12 14:41:20,267 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001
2015-02-12 14:41:20,683 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002
2015-02-12 14:41:20,687 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001
2015-02-12 14:41:20,968 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741826_1002
2015-02-12 14:41:20,974 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741825_1001
2015-02-12 14:41:23,465 INFO hs.HistoryFileManager (HistoryFileManager.java:initExisting(664)) - Initializing Existing Jobs...
2015-02-12 14:41:23,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null proto=rpc
2015-02-12 14:41:23,473 INFO hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(66)) - CachedHistoryStorage Init
2015-02-12 14:41:23,482 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:23,483 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50562
2015-02-12 14:41:23,486 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(214)) - Waiting for HistoryServer to start...
2015-02-12 14:41:23,486 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - JobHistoryServer metrics system started (again)
2015-02-12 14:41:23,487 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 14:41:23,488 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(641)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 14:41:23,489 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 14:41:23,494 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.jobhistory is not defined
2015-02-12 14:41:23,495 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:23,495 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-02-12 14:41:23,495 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:23,495 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:23,524 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /jobhistory/*
2015-02-12 14:41:23,525 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 14:41:23,531 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50564
2015-02-12 14:41:23,531 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:23,534 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_50564_jobhistory____goru89/webapp
2015-02-12 14:41:23,613 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:50564
2015-02-12 14:41:23,613 INFO webapp.WebApps (WebApps.java:start(274)) - Web app /jobhistory started at 50564
2015-02-12 14:41:23,838 INFO webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 14:41:23,846 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:23,847 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50565
2015-02-12 14:41:23,849 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-02-12 14:41:23,850 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:23,850 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50565: starting
2015-02-12 14:41:23,852 INFO hs.HistoryClientService (HistoryClientService.java:serviceStart(146)) - Instantiated HistoryClientService at 10.1.1.67/10.1.1.67:50565
2015-02-12 14:41:23,853 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:23,853 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50562: starting
2015-02-12 14:41:23,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2015-02-12 14:41:24,988 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(231)) - MiniMRYARN ResourceManager address: Edinburgh.local:0
2015-02-12 14:41:24,989 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(233)) - MiniMRYARN ResourceManager web address: Edinburgh.local:0
2015-02-12 14:41:24,989 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(235)) - MiniMRYARN HistoryServer address: 10.1.1.67:50565
2015-02-12 14:41:24,990 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(237)) - MiniMRYARN HistoryServer web address: Edinburgh.local:50564
2015-02-12 14:41:24,991 INFO server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(318)) - Waiting for RM to start...
2015-02-12 14:41:24,991 INFO resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(956)) - Transitioning to active state
2015-02-12 14:41:25,000 INFO security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(104)) - Rolling master-key for container-tokens
2015-02-12 14:41:25,001 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens
2015-02-12 14:41:25,001 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 14:41:25,001 INFO security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 1
2015-02-12 14:41:25,002 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(641)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 14:41:25,003 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 14:41:25,003 INFO security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 2
2015-02-12 14:41:25,014 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:25,015 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50566
2015-02-12 14:41:25,018 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-02-12 14:41:25,019 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:25,019 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50566: starting
2015-02-12 14:41:25,038 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:25,039 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50567
2015-02-12 14:41:25,041 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-02-12 14:41:25,042 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:25,042 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50567: starting
2015-02-12 14:41:25,081 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:25,082 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50568
2015-02-12 14:41:25,085 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-02-12 14:41:25,086 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:25,086 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50568: starting
2015-02-12 14:41:25,096 INFO resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(976)) - Transitioned to active state
2015-02-12 14:41:25,099 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.resourcemanager is not defined
2015-02-12 14:41:25,100 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:25,106 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster
2015-02-12 14:41:25,106 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs
2015-02-12 14:41:25,106 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static
2015-02-12 14:41:25,106 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-02-12 14:41:25,106 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:25,106 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:25,107 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /cluster/*
2015-02-12 14:41:25,108 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 14:41:25,109 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50569
2015-02-12 14:41:25,109 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:25,113 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_50569_cluster____cwsyxr/webapp
2015-02-12 14:41:25,922 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:50569
2015-02-12 14:41:25,922 INFO webapp.WebApps (WebApps.java:start(274)) - Web app /cluster started at 50569
2015-02-12 14:41:25,970 INFO webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 14:41:25,990 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:25,991 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50570
2015-02-12 14:41:25,994 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-02-12 14:41:25,995 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:25,998 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50570: starting
2015-02-12 14:41:26,497 INFO server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(330)) - MiniYARN ResourceManager address: 10.1.1.67:50568
2015-02-12 14:41:26,497 INFO server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(332)) - MiniYARN ResourceManager web address: Edinburgh.local:50569
2015-02-12 14:41:26,498 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(449)) - MiniYARN ResourceManager address: 10.1.1.67:50568
2015-02-12 14:41:26,498 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(451)) - MiniYARN ResourceManager web address: Edinburgh.local:50569
2015-02-12 14:41:26,500 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 0 to start...
2015-02-12 14:41:26,509 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:26,509 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50571
2015-02-12 14:41:26,512 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 14:41:26,512 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 14:41:26,512 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:26,513 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50571: starting
2015-02-12 14:41:26,519 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:50571
2015-02-12 14:41:26,524 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:26,525 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50572
2015-02-12 14:41:26,526 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 14:41:26,527 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50572: starting
2015-02-12 14:41:26,527 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:26,529 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 50572
2015-02-12 14:41:26,540 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 14:41:26,556 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 50573
2015-02-12 14:41:26,556 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:26,557 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:50571
2015-02-12 14:41:26,557 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 14:41:26,557 INFO webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 14:41:26,558 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 14:41:26,559 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:26,559 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 14:41:26,559 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:26,559 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:26,560 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 14:41:26,560 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 14:41:26,561 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50574
2015-02-12 14:41:26,561 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:26,566 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_50574_node____.6dex37/webapp
2015-02-12 14:41:26,994 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:50574
2015-02-12 14:41:26,995 INFO webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 50574
2015-02-12 14:41:27,012 INFO webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 14:41:27,014 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 14:41:27,018 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 14:41:27,029 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 14:41:27,031 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 50571 httpPort: 50574) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:50571
2015-02-12 14:41:27,032 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -1159521953
2015-02-12 14:41:27,032 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:50571 Node Transitioned from NEW to RUNNING
2015-02-12 14:41:27,035 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id -2112024912
2015-02-12 14:41:27,035 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:50571 with total resource of <memory:4096, vCores:8>
2015-02-12 14:41:27,035 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 14:41:27,039 INFO fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:50571 cluster capacity: <memory:4096, vCores:8>
2015-02-12 14:41:27,507 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 1 to start...
2015-02-12 14:41:27,511 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:27,512 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50575
2015-02-12 14:41:27,514 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 14:41:27,514 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 14:41:27,515 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:27,515 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50575: starting
2015-02-12 14:41:27,519 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:50575
2015-02-12 14:41:27,520 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:27,520 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50576
2015-02-12 14:41:27,522 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 14:41:27,523 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:27,523 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50576: starting
2015-02-12 14:41:27,524 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 50576
2015-02-12 14:41:27,525 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 14:41:27,526 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 50577
2015-02-12 14:41:27,527 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:27,527 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:50575
2015-02-12 14:41:27,527 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 14:41:27,527 INFO webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 14:41:27,528 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 14:41:27,529 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:27,529 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 14:41:27,530 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:27,530 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:27,531 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 14:41:27,531 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 14:41:27,531 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50578
2015-02-12 14:41:27,531 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:27,534 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_50578_node____g4d3pd/webapp
2015-02-12 14:41:27,787 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:50578
2015-02-12 14:41:27,788 INFO webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 50578
2015-02-12 14:41:27,794 INFO webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 14:41:27,796 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 14:41:27,796 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 14:41:27,796 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 14:41:27,798 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:50575 Node Transitioned from NEW to RUNNING
2015-02-12 14:41:27,799 INFO fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:50575 cluster capacity: <memory:8192, vCores:16>
2015-02-12 14:41:27,798 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 50575 httpPort: 50578) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:50575
2015-02-12 14:41:27,799 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -1159521953
2015-02-12 14:41:27,800 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id -2112024912
2015-02-12 14:41:27,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:50575 with total resource of <memory:4096, vCores:8>
2015-02-12 14:41:27,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 14:41:28,510 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 2 to start...
2015-02-12 14:41:28,513 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:28,514 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50579
2015-02-12 14:41:28,516 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 14:41:28,516 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 14:41:28,517 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:28,517 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50579: starting
2015-02-12 14:41:28,522 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:50579
2015-02-12 14:41:28,523 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:28,523 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50580
2015-02-12 14:41:28,525 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 14:41:28,525 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:28,525 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50580: starting
2015-02-12 14:41:28,527 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 50580
2015-02-12 14:41:28,528 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 14:41:28,529 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 50581
2015-02-12 14:41:28,529 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:28,530 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:50579
2015-02-12 14:41:28,530 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 14:41:28,530 INFO webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 14:41:28,531 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 14:41:28,531 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:28,531 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 14:41:28,531 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:28,532 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:28,532 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 14:41:28,532 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 14:41:28,533 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50582
2015-02-12 14:41:28,533 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:28,535 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_50582_node____.kvaw9y/webapp
2015-02-12 14:41:28,739 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:50582
2015-02-12 14:41:28,740 INFO webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 50582
2015-02-12 14:41:28,746 INFO webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 14:41:28,746 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 14:41:28,747 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 14:41:28,747 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 14:41:28,747 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 50579 httpPort: 50582) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:50579
2015-02-12 14:41:28,747 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:50579 Node Transitioned from NEW to RUNNING
2015-02-12 14:41:28,747 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -1159521953
2015-02-12 14:41:28,747 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id -2112024912
2015-02-12 14:41:28,747 INFO fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:50579 cluster capacity: <memory:12288, vCores:24>
2015-02-12 14:41:28,747 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:50579 with total resource of <memory:4096, vCores:8>
2015-02-12 14:41:28,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 14:41:29,516 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 3 to start...
2015-02-12 14:41:29,520 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:29,521 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50583
2015-02-12 14:41:29,523 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 14:41:29,523 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 14:41:29,524 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:29,524 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50583: starting
2015-02-12 14:41:29,528 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:50583
2015-02-12 14:41:29,529 INFO ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 14:41:29,529 INFO ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 50584
2015-02-12 14:41:29,531 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 14:41:29,531 INFO ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 14:41:29,531 INFO ipc.Server (Server.java:run(662)) - IPC Server listener on 50584: starting
2015-02-12 14:41:29,535 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 50584
2015-02-12 14:41:29,536 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 14:41:29,537 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 50585
2015-02-12 14:41:29,537 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:29,537 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:50583
2015-02-12 14:41:29,537 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 14:41:29,538 INFO webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 14:41:29,538 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 14:41:29,538 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 14:41:29,539 INFO http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 14:41:29,539 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 14:41:29,539 INFO http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 14:41:29,540 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 14:41:29,540 INFO http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 14:41:29,540 INFO http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 50586
2015-02-12 14:41:29,541 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 14:41:29,543 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_50586_node____1mh4im/webapp
2015-02-12 14:41:29,750 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:50586
2015-02-12 14:41:29,750 INFO webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 50586
2015-02-12 14:41:29,756 INFO webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 14:41:29,757 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 14:41:29,757 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 14:41:29,757 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 14:41:29,758 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 50583 httpPort: 50586) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:50583
2015-02-12 14:41:29,758 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:50583 Node Transitioned from NEW to RUNNING
2015-02-12 14:41:29,758 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -1159521953
2015-02-12 14:41:29,758 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id -2112024912
2015-02-12 14:41:29,758 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:50583 with total resource of <memory:4096, vCores:8>
2015-02-12 14:41:29,758 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 14:41:29,758 INFO fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:50583 cluster capacity: <memory:16384, vCores:32>
2015-02-12 14:41:30,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:30,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:30,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:30,541 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:41:30,543 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003 src: /127.0.0.1:50587 dest: /127.0.0.1:50549
2015-02-12 14:41:30,545 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003 src: /127.0.0.1:50588 dest: /127.0.0.1:50539
2015-02-12 14:41:30,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003 src: /127.0.0.1:50589 dest: /127.0.0.1:50543
2015-02-12 14:41:30,553 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50589, dest: /127.0.0.1:50543, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003, duration: 4305000
2015-02-12 14:41:30,554 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:30,556 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:41:30,556 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50588, dest: /127.0.0.1:50539, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003, duration: 7259000
2015-02-12 14:41:30,556 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:30,560 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:41:30,560 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50587, dest: /127.0.0.1:50549, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003, duration: 10561000
2015-02-12 14:41:30,561 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:30,562 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:30,564 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:30,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:30,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:30,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:30,572 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:41:30,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004 src: /127.0.0.1:50590 dest: /127.0.0.1:50539
2015-02-12 14:41:30,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004 src: /127.0.0.1:50591 dest: /127.0.0.1:50546
2015-02-12 14:41:30,581 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004 src: /127.0.0.1:50592 dest: /127.0.0.1:50549
2015-02-12 14:41:30,622 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50592, dest: /127.0.0.1:50549, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004, duration: 39576000
2015-02-12 14:41:30,623 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:30,624 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:30,626 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50591, dest: /127.0.0.1:50546, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004, duration: 14327000
2015-02-12 14:41:30,626 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:30,628 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:30,630 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50590, dest: /127.0.0.1:50539, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004, duration: 19073000
2015-02-12 14:41:30,630 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:30,635 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:30,637 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:30,685 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:41:30,686 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:41:30,693 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: BA326ADD1D5D49DC8E092AB665D65CB0
2015-02-12 14:41:30,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-12 14:41:30,764 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-12 14:41:30,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:30,835 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-12 14:41:30,837 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:41:30,838 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:41:30,838 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:41:30,838 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner"]
2015-02-12 14:41:30,839 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:41:30,839 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:41:30,839 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:41:30,840 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ipesplatform/cogroupinner
2015-02-12 14:41:30,865 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:41:30,937 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:41:30,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:30,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:41:30,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:41:30,979 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 1
2015-02-12 14:41:30,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001 dst=null perm=null proto=rpc
2015-02-12 14:41:30,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:41:30,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:41:30,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:30,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,003 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:41:31,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 src: /127.0.0.1:50594 dest: /127.0.0.1:50543
2015-02-12 14:41:31,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 src: /127.0.0.1:50595 dest: /127.0.0.1:50546
2015-02-12 14:41:31,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 src: /127.0.0.1:50596 dest: /127.0.0.1:50549
2015-02-12 14:41:31,021 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50596, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005, duration: 7547000
2015-02-12 14:41:31,022 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:31,023 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:41:31,023 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50595, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005, duration: 9197000
2015-02-12 14:41:31,028 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,028 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50594, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005, duration: 13135000
2015-02-12 14:41:31,030 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,030 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:41:31,031 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,035 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:31,039 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar
2015-02-12 14:41:31,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:41:31,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:41:31,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:31,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:41:31,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:41:31,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,078 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:31,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,092 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:31,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,098 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:31,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,102 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:31,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:31,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,117 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split
2015-02-12 14:41:31,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:31,122 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:41:31,125 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006 src: /127.0.0.1:50597 dest: /127.0.0.1:50543
2015-02-12 14:41:31,128 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006 src: /127.0.0.1:50598 dest: /127.0.0.1:50546
2015-02-12 14:41:31,131 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006 src: /127.0.0.1:50599 dest: /127.0.0.1:50539
2015-02-12 14:41:31,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006 src: /127.0.0.1:50600 dest: /127.0.0.1:50549
2015-02-12 14:41:31,142 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50600, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, duration: 7010000
2015-02-12 14:41:31,142 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:31,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:41:31,146 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50599, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, duration: 10550000
2015-02-12 14:41:31,146 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,150 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,150 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50598, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, duration: 14823000
2015-02-12 14:41:31,151 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,152 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50597, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, duration: 15693000
2015-02-12 14:41:31,152 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,154 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,154 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,157 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:31,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,168 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:41:31,171 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007 src: /127.0.0.1:50601 dest: /127.0.0.1:50549
2015-02-12 14:41:31,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007 src: /127.0.0.1:50602 dest: /127.0.0.1:50546
2015-02-12 14:41:31,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007 src: /127.0.0.1:50603 dest: /127.0.0.1:50539
2015-02-12 14:41:31,187 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50603, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007, duration: 7119000
2015-02-12 14:41:31,187 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:31,188 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:41:31,188 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50602, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007, duration: 7916000
2015-02-12 14:41:31,188 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,190 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,190 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50601, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007, duration: 9687000
2015-02-12 14:41:31,191 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,192 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,194 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:31,195 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:41:31,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:31,321 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:41:31,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008 src: /127.0.0.1:50604 dest: /127.0.0.1:50546
2015-02-12 14:41:31,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008 src: /127.0.0.1:50605 dest: /127.0.0.1:50543
2015-02-12 14:41:31,329 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008 src: /127.0.0.1:50606 dest: /127.0.0.1:50539
2015-02-12 14:41:31,337 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50606, dest: /127.0.0.1:50539, bytes: 97918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008, duration: 6517000
2015-02-12 14:41:31,337 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:31,338 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,338 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50605, dest: /127.0.0.1:50543, bytes: 97918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008, duration: 7428000
2015-02-12 14:41:31,339 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,340 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50604, dest: /127.0.0.1:50546, bytes: 97918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008, duration: 8949000
2015-02-12 14:41:31,340 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:31,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:31,343 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:31,344 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0001
2015-02-12 14:41:31,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001 dst=null perm=null proto=rpc
2015-02-12 14:41:31,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:31,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:31,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:31,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:31,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:31,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:31,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:31,481 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 1 submitted by user soberoi
2015-02-12 14:41:31,481 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0001
2015-02-12 14:41:31,483 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from NEW to NEW_SAVING
2015-02-12 14:41:31,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0001
2015-02-12 14:41:31,489 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0001
2015-02-12 14:41:31,508 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:41:31,515 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0001 from user: soberoi, in queue: default, currently num of applications: 1
2015-02-12 14:41:31,519 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from SUBMITTED to ACCEPTED
2015-02-12 14:41:31,537 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0001_000001
2015-02-12 14:41:31,538 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from NEW to SUBMITTED
2015-02-12 14:41:31,542 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0001_000001 to scheduler from user: soberoi
2015-02-12 14:41:31,546 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:41:31,720 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0001
2015-02-12 14:41:31,741 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0001/
2015-02-12 14:41:31,742 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0001
2015-02-12 14:41:31,742 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0001/
2015-02-12 14:41:31,776 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:31,777 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000001
2015-02-12 14:41:31,777 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:41:31,781 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0001_01_000001
2015-02-12 14:41:31,785 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:31,790 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0001_000001
2015-02-12 14:41:31,791 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0001 AttemptId: appattempt_1423780884992_0001_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0001_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:41:31,793 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:41:31,807 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:41:31,813 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0001_000001
2015-02-12 14:41:31,827 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0001_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0001_000001
2015-02-12 14:41:31,827 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:41:31,828 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0001_000001
2015-02-12 14:41:31,830 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0001_000001
2015-02-12 14:41:31,857 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:31,871 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000001 by user soberoi
2015-02-12 14:41:31,892 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0001
2015-02-12 14:41:31,899 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from NEW to INITING
2015-02-12 14:41:31,899 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000001
2015-02-12 14:41:31,900 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000001 to application application_1423780884992_0001
2015-02-12 14:41:31,907 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from INITING to RUNNING
2015-02-12 14:41:31,912 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:41:31,913 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:31,915 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0001_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0001_000001
2015-02-12 14:41:31,916 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:41:31,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:31,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:41:31,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:41:31,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:41:31,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:31,924 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:31,924 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0001_01_000001
2015-02-12 14:41:31,926 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar, 1423780872093, FILE, null }
2015-02-12 14:41:31,948 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0001_01_000001.tokens. Credentials list:
2015-02-12 14:41:32,129 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423780871962, FILE, null }
2015-02-12 14:41:32,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:32,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:41:32,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:41:32,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:32,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:41:32,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:41:32,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:32,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:41:32,272 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/filecache/10/hadoop-2896389039007281802.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:32,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:32,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:32,363 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000001.tokens
2015-02-12 14:41:32,364 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:41:32,412 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:32,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:32,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:32,564 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:32,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:32,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:32,641 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0001/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:32,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:32,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:32,721 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:32,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:32,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:32,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:32,795 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:32,797 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:32,854 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:32,854 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:32,974 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000001/default_container_executor.sh]
2015-02-12 14:41:33,482 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50543 to replicate blk_1073741829_1005 to datanode(s) 127.0.0.1:50539
2015-02-12 14:41:34,373 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 to 127.0.0.1:50539
2015-02-12 14:41:34,377 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 src: /127.0.0.1:50614 dest: /127.0.0.1:50539
2015-02-12 14:41:34,379 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:41:34,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005 src: /127.0.0.1:50614 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:41:34,381 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741829_1005 size 254067
2015-02-12 14:41:34,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:41:34,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:41:34,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:41:34,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:41:35,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001 dst=null perm=null proto=rpc
2015-02-12 14:41:35,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:41:35,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:35,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:35,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:35,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:35,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:35,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004
2015-02-12 14:41:35,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004
2015-02-12 14:41:35,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003
2015-02-12 14:41:36,417 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:36,426 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0001_000001
2015-02-12 14:41:36,427 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0001 APPATTEMPTID=appattempt_1423780884992_0001_000001
2015-02-12 14:41:36,427 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:41:36,428 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from ACCEPTED to RUNNING
2015-02-12 14:41:36,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:36,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:41:36,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:36,902 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:41:36,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009 src: /127.0.0.1:50622 dest: /127.0.0.1:50539
2015-02-12 14:41:36,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009 src: /127.0.0.1:50623 dest: /127.0.0.1:50543
2015-02-12 14:41:36,967 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009 src: /127.0.0.1:50624 dest: /127.0.0.1:50546
2015-02-12 14:41:37,007 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50624, dest: /127.0.0.1:50546, bytes: 114633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009, duration: 38443000
2015-02-12 14:41:37,008 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:37,009 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50623, dest: /127.0.0.1:50543, bytes: 114633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009, duration: 39371000
2015-02-12 14:41:37,009 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:41:37,009 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:37,010 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50622, dest: /127.0.0.1:50539, bytes: 114633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009, duration: 40570000
2015-02-12 14:41:37,010 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:37,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:37,012 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:37,016 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:37,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:37,058 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:41:37,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010 src: /127.0.0.1:50625 dest: /127.0.0.1:50539
2015-02-12 14:41:37,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010 src: /127.0.0.1:50626 dest: /127.0.0.1:50546
2015-02-12 14:41:37,072 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010 src: /127.0.0.1:50627 dest: /127.0.0.1:50549
2015-02-12 14:41:37,078 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50627, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010, duration: 3690000
2015-02-12 14:41:37,078 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:37,079 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:41:37,079 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50626, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010, duration: 4094000
2015-02-12 14:41:37,080 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:37,080 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:41:37,081 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50625, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010, duration: 5855000
2015-02-12 14:41:37,081 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:37,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:41:37,087 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001.summary is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:37,775 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:37,776 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000002
2015-02-12 14:41:37,776 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:41:37,784 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:37,784 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000003
2015-02-12 14:41:37,784 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:41:37,835 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:37,835 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000004
2015-02-12 14:41:37,835 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:41:38,091 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:38,092 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000005
2015-02-12 14:41:38,092 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:41:38,503 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0001_01_000002
2015-02-12 14:41:38,504 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:38,504 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0001_01_000003
2015-02-12 14:41:38,505 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:38,505 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0001_01_000004
2015-02-12 14:41:38,506 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:38,506 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0001_01_000005
2015-02-12 14:41:38,507 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:38,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:38,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:38,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:38,659 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:38,660 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:38,661 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:38,663 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:38,668 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000002 by user soberoi
2015-02-12 14:41:38,669 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000002
2015-02-12 14:41:38,669 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000004 by user soberoi
2015-02-12 14:41:38,670 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000003 by user soberoi
2015-02-12 14:41:38,670 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000002 to application application_1423780884992_0001
2015-02-12 14:41:38,669 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000005 by user soberoi
2015-02-12 14:41:38,672 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:41:38,672 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,672 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,672 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:41:38,673 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0001
2015-02-12 14:41:38,674 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0001
2015-02-12 14:41:38,674 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0001
2015-02-12 14:41:38,674 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000003
2015-02-12 14:41:38,673 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000004
2015-02-12 14:41:38,675 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0001
2015-02-12 14:41:38,674 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000005
2015-02-12 14:41:38,675 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from NEW to INITING
2015-02-12 14:41:38,678 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:38,678 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000003 to application application_1423780884992_0001
2015-02-12 14:41:38,674 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from NEW to INITING
2015-02-12 14:41:38,675 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from NEW to INITING
2015-02-12 14:41:38,680 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000005 to application application_1423780884992_0001
2015-02-12 14:41:38,679 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000004 to application application_1423780884992_0001
2015-02-12 14:41:38,679 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from INITING to RUNNING
2015-02-12 14:41:38,682 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from INITING to RUNNING
2015-02-12 14:41:38,682 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from INITING to RUNNING
2015-02-12 14:41:38,682 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:41:38,683 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:41:38,682 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:41:38,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,684 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,684 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:41:38,684 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0001
2015-02-12 14:41:38,685 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,685 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,685 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,685 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,685 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0001_01_000003
2015-02-12 14:41:38,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,689 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,689 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:41:38,689 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0001
2015-02-12 14:41:38,690 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,690 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,690 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,690 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar, 1423780872093, FILE, null }
2015-02-12 14:41:38,690 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,690 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0001_01_000005
2015-02-12 14:41:38,685 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0001
2015-02-12 14:41:38,692 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:41:38,693 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0001
2015-02-12 14:41:38,693 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,693 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,693 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,693 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:38,693 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0001_01_000004
2015-02-12 14:41:38,693 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar, 1423780872093, FILE, null }
2015-02-12 14:41:38,695 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar, 1423780872093, FILE, null }
2015-02-12 14:41:38,736 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0001_01_000005.tokens. Credentials list:
2015-02-12 14:41:38,771 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:38,771 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:38,776 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:38,777 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:38,777 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000006
2015-02-12 14:41:38,777 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:41:38,788 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:38,841 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:38,933 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0001_01_000004.tokens. Credentials list:
2015-02-12 14:41:38,947 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423780871962, FILE, null }
2015-02-12 14:41:38,949 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423780871962, FILE, null }
2015-02-12 14:41:38,983 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0001_01_000003.tokens. Credentials list:
2015-02-12 14:41:38,994 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423780871962, FILE, null }
2015-02-12 14:41:39,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:41:39,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:41:39,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:39,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:41:39,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:41:39,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:41:39,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:41:39,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:39,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:41:39,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:41:39,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:41:39,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:41:39,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:39,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:41:39,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:41:39,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,094 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:39,142 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/filecache/10/hadoop-2896389039007281802.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:39,150 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/filecache/10/hadoop-2896389039007281802.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:39,152 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/filecache/10/hadoop-2896389039007281802.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:39,197 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000002/default_container_executor.sh]
2015-02-12 14:41:39,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,375 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:41:39,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,401 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:41:39,450 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:39,504 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30001 milliseconds
2015-02-12 14:41:39,505 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:41:39,522 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:39,532 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:39,537 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000006 by user soberoi
2015-02-12 14:41:39,537 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000006
2015-02-12 14:41:39,537 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000006 to application application_1423780884992_0001
2015-02-12 14:41:39,543 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:41:39,543 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:39,543 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0001
2015-02-12 14:41:39,543 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:41:39,544 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0001
2015-02-12 14:41:39,544 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:39,609 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:39,609 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:39,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:41:39,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:39,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000005.tokens
2015-02-12 14:41:39,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:41:39,779 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:39,782 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:39,783 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0001
2015-02-12 14:41:39,784 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:41:39,785 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0001_01_000007 on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@73139e13
2015-02-12 14:41:39,787 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:39,787 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000008
2015-02-12 14:41:39,787 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:41:39,806 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000004.tokens
2015-02-12 14:41:39,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:41:39,809 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:39,975 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000003.tokens
2015-02-12 14:41:39,975 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000006/default_container_executor.sh]
2015-02-12 14:41:39,975 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:41:40,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:40,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:40,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:40,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:40,169 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:40,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:40,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:40,217 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:40,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:40,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:40,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:40,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:40,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006
2015-02-12 14:41:40,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003
2015-02-12 14:41:40,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741828_1004
2015-02-12 14:41:40,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007
2015-02-12 14:41:40,281 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008
2015-02-12 14:41:40,284 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005
2015-02-12 14:41:40,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:40,306 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:40,306 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:40,340 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741827_1003
2015-02-12 14:41:40,343 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005
2015-02-12 14:41:40,343 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006
2015-02-12 14:41:40,344 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008
2015-02-12 14:41:40,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:40,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:40,364 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:40,364 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:40,389 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:40,389 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:40,439 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:40,439 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:40,477 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:40,477 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:40,514 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:40,515 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:40,528 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:41:40,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:40,666 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000004/default_container_executor.sh]
2015-02-12 14:41:40,695 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007
2015-02-12 14:41:40,697 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005
2015-02-12 14:41:40,698 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006
2015-02-12 14:41:40,699 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741832_1008
2015-02-12 14:41:40,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000005/default_container_executor.sh]
2015-02-12 14:41:40,785 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0001_000001 on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096
2015-02-12 14:41:40,785 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0001 unreserved on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:41:40,820 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000003/default_container_executor.sh]
2015-02-12 14:41:40,989 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741830_1006
2015-02-12 14:41:40,991 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741829_1005
2015-02-12 14:41:40,993 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741831_1007
2015-02-12 14:41:41,537 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:41:41,538 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:41:41,538 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000008
2015-02-12 14:41:41,542 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:41:41,542 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000008 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:41:41,791 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0001_01_000008
2015-02-12 14:41:45,292 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010
2015-02-12 14:41:45,293 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009
2015-02-12 14:41:45,348 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009
2015-02-12 14:41:45,704 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741833_1009
2015-02-12 14:41:45,705 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010
2015-02-12 14:41:45,998 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741834_1010
2015-02-12 14:41:48,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:49,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:49,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:49,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:49,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:49,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:49,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:49,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:49,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:49,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:49,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:41:50,043 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:50,047 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000002
2015-02-12 14:41:50,048 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000002
2015-02-12 14:41:50,048 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:41:50,048 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000002
2015-02-12 14:41:50,072 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0001_01_000002 is : 143
2015-02-12 14:41:50,088 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:41:50,092 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:41:50,092 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011 src: /127.0.0.1:50675 dest: /127.0.0.1:50539
2015-02-12 14:41:50,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011 src: /127.0.0.1:50676 dest: /127.0.0.1:50543
2015-02-12 14:41:50,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011 src: /127.0.0.1:50677 dest: /127.0.0.1:50549
2015-02-12 14:41:50,100 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000002
2015-02-12 14:41:50,106 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000002
2015-02-12 14:41:50,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000002
2015-02-12 14:41:50,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000002
2015-02-12 14:41:50,111 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000002
2015-02-12 14:41:50,111 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist for DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:50,115 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:41:50,119 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000002 from application application_1423780884992_0001
2015-02-12 14:41:50,122 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:50,122 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:41:50,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:41:50,347 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:50,349 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000006
2015-02-12 14:41:50,350 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000006
2015-02-12 14:41:50,351 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:41:50,351 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:41:50,351 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:41:50,352 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000002
2015-02-12 14:41:50,351 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000006
2015-02-12 14:41:50,356 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:41:50,359 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000002 on node: host: 10.1.1.67:50579 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:41:50,382 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0001_01_000006 is : 143
2015-02-12 14:41:50,393 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:41:50,394 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000006
2015-02-12 14:41:50,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000006
2015-02-12 14:41:50,397 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000006
2015-02-12 14:41:50,398 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000006
2015-02-12 14:41:50,400 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000006
2015-02-12 14:41:50,400 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:41:50,401 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000006 from application application_1423780884992_0001
2015-02-12 14:41:50,401 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:50,401 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:41:50,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:41:50,537 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:50,539 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000005
2015-02-12 14:41:50,539 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000005
2015-02-12 14:41:50,540 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:41:50,540 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000005
2015-02-12 14:41:50,562 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0001_01_000005 is : 143
2015-02-12 14:41:50,571 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:41:50,572 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000005
2015-02-12 14:41:50,574 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000005
2015-02-12 14:41:50,574 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000005
2015-02-12 14:41:50,574 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000005
2015-02-12 14:41:50,575 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:41:50,576 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000005 from application application_1423780884992_0001
2015-02-12 14:41:50,576 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:50,576 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:41:50,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000005
2015-02-12 14:41:50,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:41:50,626 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:50,628 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000004
2015-02-12 14:41:50,628 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000004
2015-02-12 14:41:50,628 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:41:50,628 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000004
2015-02-12 14:41:50,650 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0001_01_000004 is : 143
2015-02-12 14:41:50,669 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:41:50,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000004
2015-02-12 14:41:50,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000004
2015-02-12 14:41:50,678 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000004
2015-02-12 14:41:50,682 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000004
2015-02-12 14:41:50,683 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000004
2015-02-12 14:41:50,687 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:41:50,689 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000004 from application application_1423780884992_0001
2015-02-12 14:41:50,689 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:50,690 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:41:50,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:41:50,734 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:50,736 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000003
2015-02-12 14:41:50,736 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000003
2015-02-12 14:41:50,738 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:41:50,738 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000003
2015-02-12 14:41:50,763 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0001_01_000003 is : 143
2015-02-12 14:41:50,772 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:41:50,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000003
2015-02-12 14:41:50,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000003
2015-02-12 14:41:50,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000003
2015-02-12 14:41:50,778 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000003
2015-02-12 14:41:50,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000003
2015-02-12 14:41:50,778 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:41:50,779 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000003 from application application_1423780884992_0001
2015-02-12 14:41:50,779 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:50,779 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:41:51,356 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:51,356 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:41:51,356 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:41:51,357 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000006
2015-02-12 14:41:51,357 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:41:51,357 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000006 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:41:51,547 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:41:51,547 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:41:51,547 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000005
2015-02-12 14:41:51,548 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:41:51,548 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000005 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:41:51,637 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:41:51,637 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:41:51,637 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000004
2015-02-12 14:41:51,637 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:41:51,638 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000004 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:41:51,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:51,639 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000009
2015-02-12 14:41:51,639 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0001_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:41:51,746 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:41:51,746 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:41:51,746 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000003
2015-02-12 14:41:51,746 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:41:51,747 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000003 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:41:52,361 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:52,361 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:52,361 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0001_01_000002]
2015-02-12 14:41:52,552 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:52,601 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:52,611 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:52,615 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0001_01_000009 by user soberoi
2015-02-12 14:41:52,616 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000009
2015-02-12 14:41:52,616 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0001_01_000009 to application application_1423780884992_0001
2015-02-12 14:41:52,616 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:41:52,617 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0001
2015-02-12 14:41:52,617 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0001
2015-02-12 14:41:52,617 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:41:52,617 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0001
2015-02-12 14:41:52,618 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:52,640 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:52,641 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:52,667 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:52,668 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:52,746 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:52,772 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000009/default_container_executor.sh]
2015-02-12 14:41:53,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0001_01_000006]
2015-02-12 14:41:53,365 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:53,495 INFO hs.JobHistory (JobHistory.java:run(198)) - History Cleaner started
2015-02-12 14:41:53,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null proto=rpc
2015-02-12 14:41:53,498 INFO hs.JobHistory (JobHistory.java:run(204)) - History Cleaner complete
2015-02-12 14:41:53,554 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:53,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0001_01_000005]
2015-02-12 14:41:53,607 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:41:53,646 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:53,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0001_01_000004]
2015-02-12 14:41:53,749 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0001_01_000003]
2015-02-12 14:41:53,749 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:55,331 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:41:55,334 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:41:55,335 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:41:55,338 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:41:55,350 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:41:55,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:55,668 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:41:55,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012 src: /127.0.0.1:50693 dest: /127.0.0.1:50543
2015-02-12 14:41:55,777 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012 src: /127.0.0.1:50694 dest: /127.0.0.1:50546
2015-02-12 14:41:55,780 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012 src: /127.0.0.1:50695 dest: /127.0.0.1:50549
2015-02-12 14:41:55,816 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50695, dest: /127.0.0.1:50549, bytes: 158, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0001_r_000000_0_1973698606_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012, duration: 33935000
2015-02-12 14:41:55,816 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:55,817 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50694, dest: /127.0.0.1:50546, bytes: 158, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0001_r_000000_0_1973698606_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012, duration: 35156000
2015-02-12 14:41:55,817 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:55,820 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:41:55,824 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50693, dest: /127.0.0.1:50543, bytes: 158, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0001_r_000000_0_1973698606_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012, duration: 41502000
2015-02-12 14:41:55,824 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:55,834 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:41:55,835 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:55,839 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0001_r_000000_0_1973698606_1
2015-02-12 14:41:55,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:41:55,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:41:55,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/task_1423780884992_0001_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:41:55,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/_temporary/attempt_1423780884992_0001_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/task_1423780884992_0001_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:41:55,896 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:41:55,898 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000009
2015-02-12 14:41:55,899 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000009
2015-02-12 14:41:55,900 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:41:55,900 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000009
2015-02-12 14:41:55,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:55,914 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:55,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:41:55,925 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0001_01_000009 is : 143
2015-02-12 14:41:55,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:55,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:55,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/task_1423780884992_0001_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:41:55,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:41:55,939 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:41:55,939 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000009
2015-02-12 14:41:55,940 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000009
2015-02-12 14:41:55,940 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:41:55,940 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000009 from application application_1423780884992_0001
2015-02-12 14:41:55,940 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:55,940 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:41:55,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000009
2015-02-12 14:41:55,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000009
2015-02-12 14:41:55,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000009
2015-02-12 14:41:55,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary/1/task_1423780884992_0001_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:55,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary dst=null perm=null proto=rpc
2015-02-12 14:41:55,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:55,968 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_SUCCESS is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:55,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:55,974 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:55,997 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50677, dest: /127.0.0.1:50549, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011, duration: 5896893000
2015-02-12 14:41:55,998 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:55,999 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16375
2015-02-12 14:41:56,000 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50676, dest: /127.0.0.1:50543, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011, duration: 5895237000
2015-02-12 14:41:56,000 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,001 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16375
2015-02-12 14:41:56,002 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50675, dest: /127.0.0.1:50539, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011, duration: 5901037000
2015-02-12 14:41:56,002 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,005 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741835_1011 size 69201
2015-02-12 14:41:56,005 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:56,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:56,012 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:41:56,025 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013 src: /127.0.0.1:50697 dest: /127.0.0.1:50546
2015-02-12 14:41:56,028 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013 src: /127.0.0.1:50698 dest: /127.0.0.1:50549
2015-02-12 14:41:56,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013 src: /127.0.0.1:50699 dest: /127.0.0.1:50539
2015-02-12 14:41:56,048 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50699, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013, duration: 6833000
2015-02-12 14:41:56,048 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:56,049 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50698, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013, duration: 8018000
2015-02-12 14:41:56,049 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:56,049 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,050 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:56,050 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50697, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013, duration: 8705000
2015-02-12 14:41:56,050 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,051 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:56,055 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:56,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:56,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:41:56,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:41:56,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:41:56,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:41:56,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:41:56,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:56,097 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:41:56,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014 src: /127.0.0.1:50701 dest: /127.0.0.1:50539
2015-02-12 14:41:56,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014 src: /127.0.0.1:50702 dest: /127.0.0.1:50549
2015-02-12 14:41:56,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014 src: /127.0.0.1:50703 dest: /127.0.0.1:50543
2015-02-12 14:41:56,107 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50703, dest: /127.0.0.1:50543, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014, duration: 2484000
2015-02-12 14:41:56,107 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:56,107 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:56,108 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50702, dest: /127.0.0.1:50549, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014, duration: 3455000
2015-02-12 14:41:56,108 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,108 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:56,109 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50701, dest: /127.0.0.1:50539, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014, duration: 4488000
2015-02-12 14:41:56,109 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,109 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:56,112 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:56,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:56,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:41:56,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:41:56,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:41:56,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:41:56,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001/job_1423780884992_0001_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:41:56,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:41:56,132 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:41:56,137 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015 src: /127.0.0.1:50704 dest: /127.0.0.1:50539
2015-02-12 14:41:56,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015 src: /127.0.0.1:50705 dest: /127.0.0.1:50549
2015-02-12 14:41:56,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015 src: /127.0.0.1:50706 dest: /127.0.0.1:50546
2015-02-12 14:41:56,151 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50706, dest: /127.0.0.1:50546, bytes: 114633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015, duration: 4330000
2015-02-12 14:41:56,151 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:56,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:41:56,154 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50705, dest: /127.0.0.1:50549, bytes: 114633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015, duration: 5532000
2015-02-12 14:41:56,155 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,158 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50704, dest: /127.0.0.1:50539, bytes: 114633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_128715976_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015, duration: 11244000
2015-02-12 14:41:56,159 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:56,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:41:56,162 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:41:56,165 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_128715976_1
2015-02-12 14:41:56,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:56,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:56,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:56,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:41:56,208 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0001_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:41:56,208 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:41:56,208 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0001 with final state: FINISHING
2015-02-12 14:41:56,209 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:41:56,209 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0001
2015-02-12 14:41:56,210 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:41:56,210 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:41:56,902 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:41:56,903 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:41:56,903 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000009
2015-02-12 14:41:56,903 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:41:56,903 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000009 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:41:57,220 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0001 unregistered successfully.
2015-02-12 14:41:57,225 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:41:57,226 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:41:57,226 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:41:57,226 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:41:57,226 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:41:57,226 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:41:57,226 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:41:57,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0001 dst=null perm=null proto=rpc
2015-02-12 14:41:57,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,295 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary
2015-02-12 14:41:57,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/_temporary dst=null perm=null proto=rpc
2015-02-12 14:41:57,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,323 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:57,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:41:57,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:41:57,383 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:57,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:41:57,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,408 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:41:57,409 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:41:57,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:41:57,433 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:41:57,433 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:41:57,433 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:41:57,433 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup"]
2015-02-12 14:41:57,433 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:41:57,433 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:41:57,434 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:41:57,435 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) .../cogroupinner-resultgroup
2015-02-12 14:41:57,444 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:41:57,457 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:41:57,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:41:57,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:41:57,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:41:57,472 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 2
2015-02-12 14:41:57,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002 dst=null perm=null proto=rpc
2015-02-12 14:41:57,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:41:57,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:41:57,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,484 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:41:57,486 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 src: /127.0.0.1:50709 dest: /127.0.0.1:50539
2015-02-12 14:41:57,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 src: /127.0.0.1:50710 dest: /127.0.0.1:50546
2015-02-12 14:41:57,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 src: /127.0.0.1:50711 dest: /127.0.0.1:50543
2015-02-12 14:41:57,494 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50711, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016, duration: 3459000
2015-02-12 14:41:57,494 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:57,495 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:41:57,495 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50710, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016, duration: 3922000
2015-02-12 14:41:57,495 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,496 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:41:57,496 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50709, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016, duration: 5545000
2015-02-12 14:41:57,497 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,501 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:57,503 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010]
2015-02-12 14:41:57,504 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011]
2015-02-12 14:41:57,504 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar
2015-02-12 14:41:57,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:41:57,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:41:57,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:41:57,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:41:57,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:41:57,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,529 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:57,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,534 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:57,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,538 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:57,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,542 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:41:57,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:41:57,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,556 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split
2015-02-12 14:41:57,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:57,558 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:41:57,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017 src: /127.0.0.1:50712 dest: /127.0.0.1:50543
2015-02-12 14:41:57,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017 src: /127.0.0.1:50713 dest: /127.0.0.1:50539
2015-02-12 14:41:57,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017 src: /127.0.0.1:50714 dest: /127.0.0.1:50549
2015-02-12 14:41:57,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017 src: /127.0.0.1:50715 dest: /127.0.0.1:50546
2015-02-12 14:41:57,575 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50715, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, duration: 4183000
2015-02-12 14:41:57,576 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:57,576 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,577 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50714, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, duration: 5219000
2015-02-12 14:41:57,577 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,578 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,578 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50713, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, duration: 6598000
2015-02-12 14:41:57,578 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,579 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,579 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50712, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, duration: 7603000
2015-02-12 14:41:57,579 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,580 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,582 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:57,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,588 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:41:57,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018 src: /127.0.0.1:50716 dest: /127.0.0.1:50546
2015-02-12 14:41:57,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018 src: /127.0.0.1:50717 dest: /127.0.0.1:50543
2015-02-12 14:41:57,599 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018 src: /127.0.0.1:50718 dest: /127.0.0.1:50549
2015-02-12 14:41:57,603 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50718, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018, duration: 2481000
2015-02-12 14:41:57,604 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:57,605 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:41:57,605 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50717, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018, duration: 2614000
2015-02-12 14:41:57,605 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,606 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:41:57,606 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50716, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018, duration: 3987000
2015-02-12 14:41:57,606 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,607 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,609 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:57,609 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:41:57,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:41:57,657 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:41:57,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019 src: /127.0.0.1:50719 dest: /127.0.0.1:50539
2015-02-12 14:41:57,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019 src: /127.0.0.1:50720 dest: /127.0.0.1:50543
2015-02-12 14:41:57,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019 src: /127.0.0.1:50721 dest: /127.0.0.1:50546
2015-02-12 14:41:57,666 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50721, dest: /127.0.0.1:50546, bytes: 97930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019, duration: 1874000
2015-02-12 14:41:57,666 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:41:57,668 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50720, dest: /127.0.0.1:50543, bytes: 97930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019, duration: 2894000
2015-02-12 14:41:57,668 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,669 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,670 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50719, dest: /127.0.0.1:50539, bytes: 97930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019, duration: 5696000
2015-02-12 14:41:57,671 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:41:57,671 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,673 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:41:57,674 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:41:57,675 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0002
2015-02-12 14:41:57,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002 dst=null perm=null proto=rpc
2015-02-12 14:41:57,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:57,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:57,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:57,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:57,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:57,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:57,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:41:57,703 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 2 submitted by user soberoi
2015-02-12 14:41:57,704 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0002
2015-02-12 14:41:57,704 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0002
2015-02-12 14:41:57,704 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from NEW to NEW_SAVING
2015-02-12 14:41:57,705 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0002
2015-02-12 14:41:57,705 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:41:57,706 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0002 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:41:57,706 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from SUBMITTED to ACCEPTED
2015-02-12 14:41:57,706 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0002_000001
2015-02-12 14:41:57,706 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from NEW to SUBMITTED
2015-02-12 14:41:57,707 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0002_000001 to scheduler from user: soberoi
2015-02-12 14:41:57,709 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:41:57,710 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0002
2015-02-12 14:41:57,714 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0002/
2015-02-12 14:41:57,714 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0002
2015-02-12 14:41:57,714 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0002/
2015-02-12 14:41:57,766 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:41:57,766 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000001
2015-02-12 14:41:57,767 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:41:57,767 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0002_01_000001
2015-02-12 14:41:57,768 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:41:57,768 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0002_000001
2015-02-12 14:41:57,768 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0002 AttemptId: appattempt_1423780884992_0002_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0002_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:41:57,768 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:41:57,768 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:41:57,769 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0002_000001
2015-02-12 14:41:57,770 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0002_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0002_000001
2015-02-12 14:41:57,771 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:41:57,771 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0002_000001
2015-02-12 14:41:57,771 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0002_000001
2015-02-12 14:41:57,775 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:41:57,777 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000001 by user soberoi
2015-02-12 14:41:57,777 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0002
2015-02-12 14:41:57,778 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000001
2015-02-12 14:41:57,778 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from NEW to INITING
2015-02-12 14:41:57,778 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000001 to application application_1423780884992_0002
2015-02-12 14:41:57,779 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from INITING to RUNNING
2015-02-12 14:41:57,779 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0002_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0002_000001
2015-02-12 14:41:57,779 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:41:57,779 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:41:57,779 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:41:57,780 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:41:57,780 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:41:57,780 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:41:57,780 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:41:57,780 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0002_01_000001
2015-02-12 14:41:57,794 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0002_01_000001.tokens. Credentials list:
2015-02-12 14:41:57,903 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:57,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:41:58,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000001.tokens
2015-02-12 14:41:58,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:41:58,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:58,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:41:58,170 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:58,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:58,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:41:58,232 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0002/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:58,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:58,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:41:58,302 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:58,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:58,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:41:58,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 14:41:58,369 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 14:41:58,369 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 14:41:58,371 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 14:41:58,372 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 14:41:58,372 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 14:41:58,372 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 14:41:58,372 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 14:41:58,372 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 14:41:58,373 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 14:41:58,375 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 14:41:58,376 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 14:41:58,376 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 14:41:58,376 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 14:41:58,384 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0002/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:41:58,384 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:41:58,427 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:41:58,427 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:41:58,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000001/default_container_executor.sh]
2015-02-12 14:41:58,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 14:41:58,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 14:41:58,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 14:41:58,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 14:41:58,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 14:41:58,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 14:41:58,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 14:41:58,743 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 14:41:58,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 14:41:58,743 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 14:41:58,743 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 14:41:58,743 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 14:41:58,769 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:41:58,904 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:41:59,907 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:00,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:00,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:42:00,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:42:00,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:42:00,507 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50543 to replicate blk_1073741840_1016 to datanode(s) 127.0.0.1:50549
2015-02-12 14:42:00,507 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741834_1010, blk_1073741835_1011]
2015-02-12 14:42:00,507 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741832_1008, blk_1073741833_1009, blk_1073741835_1011]
2015-02-12 14:42:00,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002 dst=null perm=null proto=rpc
2015-02-12 14:42:00,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:42:00,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:42:00,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:00,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:00,911 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:01,011 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741835_1011
2015-02-12 14:42:01,012 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012
2015-02-12 14:42:01,385 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 to 127.0.0.1:50549
2015-02-12 14:42:01,385 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 14:42:01,386 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 14:42:01,387 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 14:42:01,387 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 14:42:01,388 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 src: /127.0.0.1:50731 dest: /127.0.0.1:50549
2015-02-12 14:42:01,387 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 14:42:01,388 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 14:42:01,388 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:42:01,388 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 14:42:01,389 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 14:42:01,389 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 14:42:01,389 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 14:42:01,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016 src: /127.0.0.1:50731 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:42:01,391 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741840_1016 size 254067
2015-02-12 14:42:01,815 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:01,818 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0002_000001
2015-02-12 14:42:01,818 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0002 APPATTEMPTID=appattempt_1423780884992_0002_000001
2015-02-12 14:42:01,818 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:42:01,818 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from ACCEPTED to RUNNING
2015-02-12 14:42:01,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:01,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:42:01,914 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:02,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:02,031 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 14:42:02,031 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 14:42:02,032 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 14:42:02,033 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 14:42:02,266 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:42:02,279 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0001_01_000001 succeeded
2015-02-12 14:42:02,279 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:42:02,279 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0001_01_000001
2015-02-12 14:42:02,309 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000001
2015-02-12 14:42:02,309 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:42:02,309 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0001_01_000001 from application application_1423780884992_0001
2015-02-12 14:42:02,309 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:02,309 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0001
2015-02-12 14:42:02,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000001
2015-02-12 14:42:02,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000001
2015-02-12 14:42:02,312 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000001
2015-02-12 14:42:02,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0001/container_1423780884992_0001_01_000001
2015-02-12 14:42:02,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020 src: /127.0.0.1:50735 dest: /127.0.0.1:50549
2015-02-12 14:42:02,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020 src: /127.0.0.1:50736 dest: /127.0.0.1:50546
2015-02-12 14:42:02,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020 src: /127.0.0.1:50737 dest: /127.0.0.1:50543
2015-02-12 14:42:02,398 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:02,398 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0001_000001
2015-02-12 14:42:02,398 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0001_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:42:02,399 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000001
2015-02-12 14:42:02,400 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:02,400 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0001_000001 released container container_1423780884992_0001_01_000001 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:02,401 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0001_000001
2015-02-12 14:42:02,402 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0001_000001 State change from FINISHING to FINISHED
2015-02-12 14:42:02,405 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0001 State change from FINISHING to FINISHED
2015-02-12 14:42:02,405 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0001_000001 is done. finalState=FINISHED
2015-02-12 14:42:02,406 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0001 requests cleared
2015-02-12 14:42:02,406 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0001
2015-02-12 14:42:02,406 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0001_000001
2015-02-12 14:42:02,415 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0001,name=[D1C3795DE98A405AB91B444FF9285EA0/447BBBFC9DF940A897F4002777F82764] lower*upper/(1/1) ...ipesplatform/cogroupinner,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0001/jobhistory/job/job_1423780884992_0001,appMasterHost=10.1.1.67,startTime=1423780891481,finishTime=1423780916208,finalStatus=SUCCEEDED
2015-02-12 14:42:02,417 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0001_000001 (auth:SIMPLE)
2015-02-12 14:42:02,423 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0001_01_000001
2015-02-12 14:42:02,424 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0001 CONTAINERID=container_1423780884992_0001_01_000001
2015-02-12 14:42:02,424 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0001_01_000001]
2015-02-12 14:42:02,424 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:02,426 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:02,426 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,426 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,430 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,432 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0001
2015-02-12 14:42:02,433 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:02,434 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0001, with delay of 10800 seconds
2015-02-12 14:42:02,454 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50737, dest: /127.0.0.1:50543, bytes: 114645, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020, duration: 113518000
2015-02-12 14:42:02,455 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:02,456 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:42:02,457 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50736, dest: /127.0.0.1:50546, bytes: 114645, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020, duration: 115946000
2015-02-12 14:42:02,457 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:02,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:42:02,458 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50735, dest: /127.0.0.1:50549, bytes: 114645, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020, duration: 117384000
2015-02-12 14:42:02,458 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:02,458 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:02,465 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:02,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:02,514 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:42:02,519 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021 src: /127.0.0.1:50739 dest: /127.0.0.1:50539
2015-02-12 14:42:02,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021 src: /127.0.0.1:50740 dest: /127.0.0.1:50546
2015-02-12 14:42:02,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021 src: /127.0.0.1:50741 dest: /127.0.0.1:50543
2015-02-12 14:42:02,528 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50741, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021, duration: 3770000
2015-02-12 14:42:02,529 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:02,529 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:42:02,529 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50740, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021, duration: 4493000
2015-02-12 14:42:02,530 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:02,530 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:42:02,531 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50739, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021, duration: 5708000
2015-02-12 14:42:02,531 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:02,532 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:42:02,535 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002.summary is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:02,579 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:02,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,581 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,582 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,582 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0001
2015-02-12 14:42:02,582 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:02,583 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0001, with delay of 10800 seconds
2015-02-12 14:42:02,782 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:02,782 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,782 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,783 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0001
2015-02-12 14:42:02,784 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,784 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:02,784 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0001, with delay of 10800 seconds
2015-02-12 14:42:02,919 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:02,919 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:02,920 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:02,920 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000002
2015-02-12 14:42:02,920 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:42:02,922 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0001
2015-02-12 14:42:02,923 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:02,923 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0001, with delay of 10800 seconds
2015-02-12 14:42:02,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,924 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:02,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0001
2015-02-12 14:42:03,427 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:03,427 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000003
2015-02-12 14:42:03,427 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:42:03,582 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:03,582 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000004
2015-02-12 14:42:03,582 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:42:03,787 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:03,787 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000005
2015-02-12 14:42:03,788 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:42:03,881 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0002_01_000002
2015-02-12 14:42:03,882 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:03,882 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0002_01_000003
2015-02-12 14:42:03,882 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:03,883 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0002_01_000004
2015-02-12 14:42:03,883 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:03,884 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0002_01_000005
2015-02-12 14:42:03,884 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:03,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,921 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:03,922 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:03,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,922 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000006
2015-02-12 14:42:03,922 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:42:03,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:03,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:03,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:03,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,032 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:04,033 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:04,032 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:04,038 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000003 by user soberoi
2015-02-12 14:42:04,038 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0002
2015-02-12 14:42:04,039 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000003
2015-02-12 14:42:04,039 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from NEW to INITING
2015-02-12 14:42:04,040 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000003 to application application_1423780884992_0002
2015-02-12 14:42:04,040 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from INITING to RUNNING
2015-02-12 14:42:04,040 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:42:04,040 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,040 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,041 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:04,041 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0002
2015-02-12 14:42:04,041 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:04,041 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:04,041 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0002_01_000003
2015-02-12 14:42:04,041 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:04,043 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000002 by user soberoi
2015-02-12 14:42:04,043 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0002
2015-02-12 14:42:04,044 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000002
2015-02-12 14:42:04,044 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from NEW to INITING
2015-02-12 14:42:04,044 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000002 to application application_1423780884992_0002
2015-02-12 14:42:04,045 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from INITING to RUNNING
2015-02-12 14:42:04,045 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:42:04,046 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,046 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,046 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:04,046 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0002
2015-02-12 14:42:04,046 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:04,046 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000005 by user soberoi
2015-02-12 14:42:04,047 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000005
2015-02-12 14:42:04,048 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:04,048 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0002_01_000002
2015-02-12 14:42:04,048 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000005 to application application_1423780884992_0002
2015-02-12 14:42:04,049 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:42:04,049 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,049 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,049 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:04,049 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0002
2015-02-12 14:42:04,050 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:04,053 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000004 by user soberoi
2015-02-12 14:42:04,053 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0002
2015-02-12 14:42:04,054 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000004
2015-02-12 14:42:04,059 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from NEW to INITING
2015-02-12 14:42:04,060 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000004 to application application_1423780884992_0002
2015-02-12 14:42:04,060 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from INITING to RUNNING
2015-02-12 14:42:04,061 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:42:04,061 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,061 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,061 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:04,061 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0002
2015-02-12 14:42:04,061 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:04,061 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:04,063 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0002_01_000004
2015-02-12 14:42:04,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0002_01_000003.tokens. Credentials list:
2015-02-12 14:42:04,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0002_01_000002.tokens. Credentials list:
2015-02-12 14:42:04,107 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0002_01_000004.tokens. Credentials list:
2015-02-12 14:42:04,230 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:04,230 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:04,314 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:04,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:04,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:04,430 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:04,469 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000005/default_container_executor.sh]
2015-02-12 14:42:04,494 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0002_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000002.tokens
2015-02-12 14:42:04,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:04,509 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0002_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000004.tokens
2015-02-12 14:42:04,509 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:04,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0002_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000003.tokens
2015-02-12 14:42:04,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:04,583 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:04,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:04,787 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:04,795 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:04,804 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:04,814 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:04,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:04,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:04,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:04,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:04,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:04,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:04,899 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:04,910 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:04,913 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000006 by user soberoi
2015-02-12 14:42:04,914 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000006
2015-02-12 14:42:04,914 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000006 to application application_1423780884992_0002
2015-02-12 14:42:04,914 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:42:04,915 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,915 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0002
2015-02-12 14:42:04,915 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:04,915 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0002
2015-02-12 14:42:04,915 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0002_01_000006
2015-02-12 14:42:04,922 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:04,923 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:04,924 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:04,924 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000007
2015-02-12 14:42:04,925 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:42:04,939 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:04,939 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:04,939 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:04,939 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:04,940 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:04,945 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0002_01_000006.tokens. Credentials list:
2015-02-12 14:42:04,951 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:04,951 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:05,019 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:05,020 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:05,020 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:05,021 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:05,021 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:05,021 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:05,022 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:05,022 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:05,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000002/default_container_executor.sh]
2015-02-12 14:42:05,306 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014
2015-02-12 14:42:05,306 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013
2015-02-12 14:42:05,307 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015
2015-02-12 14:42:05,308 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017
2015-02-12 14:42:05,310 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016
2015-02-12 14:42:05,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000004/default_container_executor.sh]
2015-02-12 14:42:05,327 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000003/default_container_executor.sh]
2015-02-12 14:42:05,327 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000006/default_container_executor.sh]
2015-02-12 14:42:05,358 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012
2015-02-12 14:42:05,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016
2015-02-12 14:42:05,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014
2015-02-12 14:42:05,362 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018
2015-02-12 14:42:05,362 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017
2015-02-12 14:42:05,364 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019
2015-02-12 14:42:05,514 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019
2015-02-12 14:42:05,728 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018
2015-02-12 14:42:05,729 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017
2015-02-12 14:42:05,729 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741836_1012
2015-02-12 14:42:05,730 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015
2015-02-12 14:42:05,731 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013
2015-02-12 14:42:05,732 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741843_1019
2015-02-12 14:42:05,734 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016
2015-02-12 14:42:05,906 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:42:05,907 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:05,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:06,015 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741838_1014
2015-02-12 14:42:06,016 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741842_1018
2015-02-12 14:42:06,017 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741839_1015
2015-02-12 14:42:06,018 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741837_1013
2015-02-12 14:42:06,019 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741841_1017
2015-02-12 14:42:06,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0002_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000006.tokens
2015-02-12 14:42:06,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:06,911 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:42:06,912 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:42:06,912 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000007
2015-02-12 14:42:06,913 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:42:06,913 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000007 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:42:06,925 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0002_01_000007
2015-02-12 14:42:09,507 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 14:42:09,507 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:42:10,370 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020
2015-02-12 14:42:10,370 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021
2015-02-12 14:42:10,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021
2015-02-12 14:42:10,742 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020
2015-02-12 14:42:10,742 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741845_1021
2015-02-12 14:42:11,023 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741844_1020
2015-02-12 14:42:11,025 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741840_1016
2015-02-12 14:42:14,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:14,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:14,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:14,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:14,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:14,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:14,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:14,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:14,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:14,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:15,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:42:15,262 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:15,264 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000005
2015-02-12 14:42:15,265 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000005
2015-02-12 14:42:15,265 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:42:15,265 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000005
2015-02-12 14:42:15,290 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:42:15,290 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 181 Total time for transactions(ms): 26 Number of transactions batched in Syncs: 0 Number of syncs: 110 SyncTimes(ms): 32 30
2015-02-12 14:42:15,292 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0002_01_000005 is : 143
2015-02-12 14:42:15,293 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022 src: /127.0.0.1:50782 dest: /127.0.0.1:50549
2015-02-12 14:42:15,296 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022 src: /127.0.0.1:50783 dest: /127.0.0.1:50539
2015-02-12 14:42:15,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022 src: /127.0.0.1:50784 dest: /127.0.0.1:50546
2015-02-12 14:42:15,302 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:15,309 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000005
2015-02-12 14:42:15,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000005
2015-02-12 14:42:15,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000005
2015-02-12 14:42:15,311 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000005
2015-02-12 14:42:15,311 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:15,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000005
2015-02-12 14:42:15,311 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000005 from application application_1423780884992_0002
2015-02-12 14:42:15,311 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:15,311 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:15,314 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist for DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:15,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:42:15,500 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:15,502 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000003
2015-02-12 14:42:15,502 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000003
2015-02-12 14:42:15,502 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:42:15,502 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000003
2015-02-12 14:42:15,522 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0002_01_000003 is : 143
2015-02-12 14:42:15,533 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:15,533 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000003
2015-02-12 14:42:15,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000003
2015-02-12 14:42:15,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000003
2015-02-12 14:42:15,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000003
2015-02-12 14:42:15,536 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000003
2015-02-12 14:42:15,536 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:15,536 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000003 from application application_1423780884992_0002
2015-02-12 14:42:15,537 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:15,537 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:15,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:42:15,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:42:15,597 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:15,601 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000002
2015-02-12 14:42:15,602 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000002
2015-02-12 14:42:15,602 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:42:15,602 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000002
2015-02-12 14:42:15,604 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:15,606 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000006
2015-02-12 14:42:15,606 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000006
2015-02-12 14:42:15,626 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0002_01_000002 is : 143
2015-02-12 14:42:15,638 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:42:15,639 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:15,639 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000006
2015-02-12 14:42:15,660 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0002_01_000006 is : 143
2015-02-12 14:42:15,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000002
2015-02-12 14:42:15,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000002
2015-02-12 14:42:15,677 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000002
2015-02-12 14:42:15,679 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000002
2015-02-12 14:42:15,679 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:15,680 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000002
2015-02-12 14:42:15,681 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:15,682 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000006
2015-02-12 14:42:15,686 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000006
2015-02-12 14:42:15,687 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000006
2015-02-12 14:42:15,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000006
2015-02-12 14:42:15,690 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000002 from application application_1423780884992_0002
2015-02-12 14:42:15,691 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:15,691 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:15,692 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000006
2015-02-12 14:42:15,692 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:15,692 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000006 from application application_1423780884992_0002
2015-02-12 14:42:15,692 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:15,692 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:15,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:42:15,765 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:15,770 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000004
2015-02-12 14:42:15,770 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000004
2015-02-12 14:42:15,770 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:42:15,771 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000004
2015-02-12 14:42:15,796 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0002_01_000004 is : 143
2015-02-12 14:42:15,814 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:15,815 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000004
2015-02-12 14:42:15,815 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:15,815 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000004 from application application_1423780884992_0002
2015-02-12 14:42:15,815 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:15,815 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:15,816 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000004
2015-02-12 14:42:15,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000004
2015-02-12 14:42:15,818 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000004
2015-02-12 14:42:15,819 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000004
2015-02-12 14:42:16,268 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:16,268 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:42:16,268 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000005
2015-02-12 14:42:16,268 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:42:16,269 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000005 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:42:16,505 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:16,505 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:42:16,506 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000003
2015-02-12 14:42:16,506 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:16,506 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:16,611 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:16,611 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:42:16,611 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000002
2015-02-12 14:42:16,611 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:42:16,611 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000002 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:42:16,612 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:16,612 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:42:16,612 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000006
2015-02-12 14:42:16,612 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:16,613 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000006 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:16,772 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:16,772 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:42:16,772 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000004
2015-02-12 14:42:16,773 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:16,773 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:17,271 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:17,272 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:17,272 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000008
2015-02-12 14:42:17,272 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0002_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:42:17,509 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:17,612 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:17,612 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:17,774 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:17,982 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:17,992 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:17,994 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0002_01_000008 by user soberoi
2015-02-12 14:42:17,994 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000008
2015-02-12 14:42:17,994 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0002_01_000008 to application application_1423780884992_0002
2015-02-12 14:42:17,995 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:42:17,995 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0002
2015-02-12 14:42:17,995 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0002
2015-02-12 14:42:17,995 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:17,995 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0002
2015-02-12 14:42:17,996 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:18,029 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:18,030 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:18,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000008/default_container_executor.sh]
2015-02-12 14:42:18,272 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0002_01_000005]
2015-02-12 14:42:18,272 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:18,272 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:18,513 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0002_01_000003]
2015-02-12 14:42:18,513 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:18,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0002_01_000006, container_1423780884992_0002_01_000002]
2015-02-12 14:42:18,617 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:18,617 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:18,775 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0002_01_000004]
2015-02-12 14:42:18,776 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:18,989 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:42:20,597 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:20,600 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:20,604 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:20,607 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:20,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:20,924 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:42:21,040 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023 src: /127.0.0.1:50796 dest: /127.0.0.1:50546
2015-02-12 14:42:21,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023 src: /127.0.0.1:50797 dest: /127.0.0.1:50549
2015-02-12 14:42:21,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023 src: /127.0.0.1:50798 dest: /127.0.0.1:50539
2015-02-12 14:42:21,075 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50798, dest: /127.0.0.1:50539, bytes: 158, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0002_r_000000_0_-569485701_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023, duration: 29275000
2015-02-12 14:42:21,075 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:21,077 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,077 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50797, dest: /127.0.0.1:50549, bytes: 158, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0002_r_000000_0_-569485701_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023, duration: 31319000
2015-02-12 14:42:21,078 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,080 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50796, dest: /127.0.0.1:50546, bytes: 158, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0002_r_000000_0_-569485701_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023, duration: 33947000
2015-02-12 14:42:21,080 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,084 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,091 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0002_r_000000_0_-569485701_1
2015-02-12 14:42:21,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:42:21,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:42:21,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/task_1423780884992_0002_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:42:21,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0002_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/task_1423780884992_0002_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:42:21,141 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:21,144 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000008
2015-02-12 14:42:21,144 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000008
2015-02-12 14:42:21,145 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:42:21,145 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000008
2015-02-12 14:42:21,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,167 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:42:21,181 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0002_01_000008 is : 143
2015-02-12 14:42:21,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:21,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:21,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/task_1423780884992_0002_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:42:21,199 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:21,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:21,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000008
2015-02-12 14:42:21,201 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000008
2015-02-12 14:42:21,201 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000008
2015-02-12 14:42:21,201 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000008
2015-02-12 14:42:21,202 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:21,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000008
2015-02-12 14:42:21,203 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000008 from application application_1423780884992_0002
2015-02-12 14:42:21,203 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:21,203 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:21,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary/1/task_1423780884992_0002_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:42:21,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,221 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,229 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,250 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50784, dest: /127.0.0.1:50546, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022, duration: 5948404000
2015-02-12 14:42:21,251 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:21,253 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16374
2015-02-12 14:42:21,253 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50783, dest: /127.0.0.1:50539, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022, duration: 5950635000
2015-02-12 14:42:21,254 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16374
2015-02-12 14:42:21,255 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50782, dest: /127.0.0.1:50549, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022, duration: 5953678000
2015-02-12 14:42:21,256 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16374
2015-02-12 14:42:21,259 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,266 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:42:21,269 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024 src: /127.0.0.1:50800 dest: /127.0.0.1:50546
2015-02-12 14:42:21,270 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024 src: /127.0.0.1:50801 dest: /127.0.0.1:50543
2015-02-12 14:42:21,272 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024 src: /127.0.0.1:50802 dest: /127.0.0.1:50549
2015-02-12 14:42:21,276 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50802, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024, duration: 2177000
2015-02-12 14:42:21,277 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:21,277 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,277 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50801, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024, duration: 2906000
2015-02-12 14:42:21,278 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,279 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50800, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024, duration: 4486000
2015-02-12 14:42:21,279 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,281 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:21,282 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:21,287 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:21,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:42:21,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:21,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:42:21,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:21,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:42:21,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,322 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:42:21,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025 src: /127.0.0.1:50804 dest: /127.0.0.1:50546
2015-02-12 14:42:21,327 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025 src: /127.0.0.1:50805 dest: /127.0.0.1:50549
2015-02-12 14:42:21,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025 src: /127.0.0.1:50806 dest: /127.0.0.1:50543
2015-02-12 14:42:21,332 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50806, dest: /127.0.0.1:50543, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025, duration: 2185000
2015-02-12 14:42:21,333 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:21,333 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,333 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50805, dest: /127.0.0.1:50549, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025, duration: 2425000
2015-02-12 14:42:21,333 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,334 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:21,334 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50804, dest: /127.0.0.1:50546, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025, duration: 3563000
2015-02-12 14:42:21,335 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,335 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:21,338 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:21,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:42:21,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:21,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:42:21,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:21,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002/job_1423780884992_0002_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:42:21,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:21,369 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:42:21,372 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026 src: /127.0.0.1:50808 dest: /127.0.0.1:50543
2015-02-12 14:42:21,374 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026 src: /127.0.0.1:50809 dest: /127.0.0.1:50539
2015-02-12 14:42:21,375 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026 src: /127.0.0.1:50810 dest: /127.0.0.1:50549
2015-02-12 14:42:21,379 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50810, dest: /127.0.0.1:50549, bytes: 114645, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026, duration: 2047000
2015-02-12 14:42:21,379 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:21,380 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,381 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50809, dest: /127.0.0.1:50539, bytes: 114645, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026, duration: 3671000
2015-02-12 14:42:21,381 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,382 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,383 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50808, dest: /127.0.0.1:50543, bytes: 114645, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1044883592_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026, duration: 5053000
2015-02-12 14:42:21,383 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:21,383 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:21,385 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1044883592_1
2015-02-12 14:42:21,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:21,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:21,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:21,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:21,413 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0002_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:42:21,413 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:42:21,413 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0002 with final state: FINISHING
2015-02-12 14:42:21,414 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from RUNNING to FINAL_SAVING
2015-02-12 14:42:21,414 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0002
2015-02-12 14:42:21,414 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:42:21,414 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from FINAL_SAVING to FINISHING
2015-02-12 14:42:22,151 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:22,151 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:42:22,151 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000008
2015-02-12 14:42:22,152 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:42:22,152 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000008 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:42:22,424 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0002 unregistered successfully.
2015-02-12 14:42:22,430 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:42:22,430 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:42:22,431 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:42:22,431 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:42:22,431 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:42:22,431 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741846_1022 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:42:22,432 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:42:22,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0002 dst=null perm=null proto=rpc
2015-02-12 14:42:22,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,473 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary
2015-02-12 14:42:22,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:42:22,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,498 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:22,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,525 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:22,530 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner
2015-02-12 14:42:22,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:42:22,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:42:22,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:42:22,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner dst=null perm=null proto=rpc
2015-02-12 14:42:22,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:22,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:22,538 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup
2015-02-12 14:42:22,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:42:22,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:22,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:22,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,561 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:42:22,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027 src: /127.0.0.1:50816 dest: /127.0.0.1:50543
2015-02-12 14:42:22,566 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027 src: /127.0.0.1:50817 dest: /127.0.0.1:50546
2015-02-12 14:42:22,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027 src: /127.0.0.1:50818 dest: /127.0.0.1:50549
2015-02-12 14:42:22,570 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50818, dest: /127.0.0.1:50549, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027, duration: 1455000
2015-02-12 14:42:22,570 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,572 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50817, dest: /127.0.0.1:50546, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027, duration: 2420000
2015-02-12 14:42:22,572 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,573 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50816, dest: /127.0.0.1:50543, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027, duration: 4061000
2015-02-12 14:42:22,574 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,574 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,580 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,582 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,593 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:42:22,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028 src: /127.0.0.1:50819 dest: /127.0.0.1:50549
2015-02-12 14:42:22,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028 src: /127.0.0.1:50820 dest: /127.0.0.1:50543
2015-02-12 14:42:22,599 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028 src: /127.0.0.1:50821 dest: /127.0.0.1:50546
2015-02-12 14:42:22,605 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50821, dest: /127.0.0.1:50546, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028, duration: 2105000
2015-02-12 14:42:22,605 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,606 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,606 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50820, dest: /127.0.0.1:50543, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028, duration: 2587000
2015-02-12 14:42:22,606 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,608 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50819, dest: /127.0.0.1:50549, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028, duration: 4396000
2015-02-12 14:42:22,608 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,608 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,609 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,613 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,620 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:42:22,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029 src: /127.0.0.1:50822 dest: /127.0.0.1:50546
2015-02-12 14:42:22,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029 src: /127.0.0.1:50823 dest: /127.0.0.1:50543
2015-02-12 14:42:22,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029 src: /127.0.0.1:50824 dest: /127.0.0.1:50549
2015-02-12 14:42:22,628 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50824, dest: /127.0.0.1:50549, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029, duration: 1623000
2015-02-12 14:42:22,629 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,630 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50823, dest: /127.0.0.1:50543, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029, duration: 2438000
2015-02-12 14:42:22,630 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,632 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50822, dest: /127.0.0.1:50546, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029, duration: 4323000
2015-02-12 14:42:22,632 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,633 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,635 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,635 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,637 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,670 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:42:22,671 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:42:22,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:22,703 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] starting
2015-02-12 14:42:22,703 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:42:22,703 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:42:22,704 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt"]
2015-02-12 14:42:22,704 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] sink: Hfs["TextDelimited[[0:5]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed"]
2015-02-12 14:42:22,704 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] parallel execution is enabled: true
2015-02-12 14:42:22,704 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] starting jobs: 1
2015-02-12 14:42:22,704 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [loweroffset*upper*lower] allocating threads: 1
2015-02-12 14:42:22,705 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [loweroffset*upper*lower] starting step: (1/1) ...ipesplatform/cogroupmixed
2015-02-12 14:42:22,721 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:42:22,738 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:42:22,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:22,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:22,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:22,746 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 3
2015-02-12 14:42:22,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003 dst=null perm=null proto=rpc
2015-02-12 14:42:22,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:42:22,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:42:22,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,763 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:42:22,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 src: /127.0.0.1:50826 dest: /127.0.0.1:50546
2015-02-12 14:42:22,767 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 src: /127.0.0.1:50827 dest: /127.0.0.1:50543
2015-02-12 14:42:22,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 src: /127.0.0.1:50828 dest: /127.0.0.1:50539
2015-02-12 14:42:22,774 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50828, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030, duration: 2138000
2015-02-12 14:42:22,775 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,775 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50827, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030, duration: 3148000
2015-02-12 14:42:22,775 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,776 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,776 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,777 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50826, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030, duration: 4122000
2015-02-12 14:42:22,777 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,780 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,782 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,784 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar
2015-02-12 14:42:22,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:42:22,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:42:22,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:42:22,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:42:22,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:42:22,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,799 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,803 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,810 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,815 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,822 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,827 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:22,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:22,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,838 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split
2015-02-12 14:42:22,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:22,841 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:42:22,843 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031 src: /127.0.0.1:50829 dest: /127.0.0.1:50539
2015-02-12 14:42:22,845 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031 src: /127.0.0.1:50830 dest: /127.0.0.1:50546
2015-02-12 14:42:22,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031 src: /127.0.0.1:50831 dest: /127.0.0.1:50549
2015-02-12 14:42:22,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031 src: /127.0.0.1:50832 dest: /127.0.0.1:50543
2015-02-12 14:42:22,851 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50832, dest: /127.0.0.1:50543, bytes: 3235, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, duration: 1944000
2015-02-12 14:42:22,852 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,852 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,852 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50831, dest: /127.0.0.1:50549, bytes: 3235, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, duration: 2783000
2015-02-12 14:42:22,853 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,853 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,854 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50830, dest: /127.0.0.1:50546, bytes: 3235, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, duration: 3981000
2015-02-12 14:42:22,854 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,855 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50829, dest: /127.0.0.1:50539, bytes: 3235, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, duration: 5509000
2015-02-12 14:42:22,855 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,855 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,857 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,863 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,872 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:42:22,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032 src: /127.0.0.1:50833 dest: /127.0.0.1:50546
2015-02-12 14:42:22,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032 src: /127.0.0.1:50834 dest: /127.0.0.1:50549
2015-02-12 14:42:22,881 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032 src: /127.0.0.1:50835 dest: /127.0.0.1:50543
2015-02-12 14:42:22,885 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50835, dest: /127.0.0.1:50543, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032, duration: 1482000
2015-02-12 14:42:22,885 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,886 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,886 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50834, dest: /127.0.0.1:50549, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032, duration: 2286000
2015-02-12 14:42:22,887 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,888 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:42:22,889 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50833, dest: /127.0.0.1:50546, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032, duration: 5162000
2015-02-12 14:42:22,889 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,891 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,895 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,896 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:9
2015-02-12 14:42:22,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:22,927 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:42:22,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033 src: /127.0.0.1:50836 dest: /127.0.0.1:50549
2015-02-12 14:42:22,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033 src: /127.0.0.1:50837 dest: /127.0.0.1:50546
2015-02-12 14:42:22,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033 src: /127.0.0.1:50838 dest: /127.0.0.1:50539
2015-02-12 14:42:22,939 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50838, dest: /127.0.0.1:50539, bytes: 98337, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033, duration: 1979000
2015-02-12 14:42:22,939 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:22,940 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,940 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50837, dest: /127.0.0.1:50546, bytes: 98337, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033, duration: 2506000
2015-02-12 14:42:22,941 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,942 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50836, dest: /127.0.0.1:50549, bytes: 98337, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033, duration: 3931000
2015-02-12 14:42:22,942 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,942 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:22,946 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:22,948 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:22,948 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0003
2015-02-12 14:42:22,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003 dst=null perm=null proto=rpc
2015-02-12 14:42:22,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:22,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:22,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:22,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:22,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:22,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:22,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:22,983 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 3 submitted by user soberoi
2015-02-12 14:42:22,983 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0003
2015-02-12 14:42:22,984 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0003
2015-02-12 14:42:22,985 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0003
2015-02-12 14:42:22,984 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from NEW to NEW_SAVING
2015-02-12 14:42:22,986 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:42:22,987 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0003 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:42:22,988 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from SUBMITTED to ACCEPTED
2015-02-12 14:42:22,988 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0003_000001
2015-02-12 14:42:22,989 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from NEW to SUBMITTED
2015-02-12 14:42:22,989 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0003_000001 to scheduler from user: soberoi
2015-02-12 14:42:22,990 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:42:22,991 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0003
2015-02-12 14:42:22,997 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0003/
2015-02-12 14:42:22,997 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [loweroffset*upper*lower] submitted hadoop job: job_1423780884992_0003
2015-02-12 14:42:22,997 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [loweroffset*upper*lower] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0003/
2015-02-12 14:42:23,156 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:23,157 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:23,158 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000001
2015-02-12 14:42:23,158 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:42:23,158 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0003_01_000001
2015-02-12 14:42:23,159 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:23,159 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0003_000001
2015-02-12 14:42:23,159 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0003 AttemptId: appattempt_1423780884992_0003_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0003_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:42:23,160 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:42:23,160 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:42:23,161 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0003_000001
2015-02-12 14:42:23,162 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0003_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0003_000001
2015-02-12 14:42:23,162 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:42:23,162 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0003_000001
2015-02-12 14:42:23,162 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0003_000001
2015-02-12 14:42:23,165 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:23,168 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000001 by user soberoi
2015-02-12 14:42:23,168 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0003
2015-02-12 14:42:23,168 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000001
2015-02-12 14:42:23,168 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from NEW to INITING
2015-02-12 14:42:23,168 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000001 to application application_1423780884992_0003
2015-02-12 14:42:23,169 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from INITING to RUNNING
2015-02-12 14:42:23,169 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0003_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0003_000001
2015-02-12 14:42:23,169 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:42:23,169 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:42:23,169 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:23,169 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:23,170 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:42:23,170 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:42:23,170 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:23,170 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000001
2015-02-12 14:42:23,180 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0003_01_000001.tokens. Credentials list:
2015-02-12 14:42:23,293 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:23,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000001.tokens
2015-02-12 14:42:23,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:23,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:23,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:23,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:23,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:23,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:23,592 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:23,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:23,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:23,663 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:23,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:23,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:23,737 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:23,737 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:23,777 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:23,778 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:23,888 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000001/default_container_executor.sh]
2015-02-12 14:42:24,161 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:24,161 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:24,534 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073741854_1030 to datanode(s) 127.0.0.1:50549
2015-02-12 14:42:24,534 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022]
2015-02-12 14:42:24,534 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741844_1020, blk_1073741846_1022]
2015-02-12 14:42:25,162 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:25,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:25,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:42:25,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:42:25,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:42:25,764 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 to 127.0.0.1:50549
2015-02-12 14:42:25,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 14:42:25,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 14:42:25,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 14:42:25,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 14:42:25,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 14:42:25,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741845 for deletion
2015-02-12 14:42:25,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741846 for deletion
2015-02-12 14:42:25,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 14:42:25,766 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 14:42:25,766 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 14:42:25,766 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741846
2015-02-12 14:42:25,767 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 14:42:25,767 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 14:42:25,767 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741845
2015-02-12 14:42:25,774 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:42:25,779 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 src: /127.0.0.1:50844 dest: /127.0.0.1:50549
2015-02-12 14:42:25,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030 src: /127.0.0.1:50844 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:42:25,782 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741854_1030 size 254067
2015-02-12 14:42:25,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003 dst=null perm=null proto=rpc
2015-02-12 14:42:25,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:42:25,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:42:26,037 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741846 for deletion
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 14:42:26,038 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 14:42:26,039 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741846
2015-02-12 14:42:26,039 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 14:42:26,166 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:26,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:26,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:27,126 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:27,129 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0003_000001
2015-02-12 14:42:27,129 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0003 APPATTEMPTID=appattempt_1423780884992_0003_000001
2015-02-12 14:42:27,130 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:42:27,130 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from ACCEPTED to RUNNING
2015-02-12 14:42:27,171 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:27,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:27,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:42:27,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:27,478 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0002_01_000001 succeeded
2015-02-12 14:42:27,478 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:42:27,478 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0002_01_000001
2015-02-12 14:42:27,504 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000001
2015-02-12 14:42:27,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000001
2015-02-12 14:42:27,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000001
2015-02-12 14:42:27,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002/container_1423780884992_0002_01_000001
2015-02-12 14:42:27,506 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000001
2015-02-12 14:42:27,506 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:42:27,506 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0002_01_000001 from application application_1423780884992_0002
2015-02-12 14:42:27,507 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:27,507 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0002
2015-02-12 14:42:27,536 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741843_1019, blk_1073741845_1021, blk_1073741846_1022]
2015-02-12 14:42:27,536 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021]
2015-02-12 14:42:27,571 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:42:27,632 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034 src: /127.0.0.1:50864 dest: /127.0.0.1:50546
2015-02-12 14:42:27,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034 src: /127.0.0.1:50865 dest: /127.0.0.1:50543
2015-02-12 14:42:27,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034 src: /127.0.0.1:50866 dest: /127.0.0.1:50549
2015-02-12 14:42:27,673 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50866, dest: /127.0.0.1:50549, bytes: 115052, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034, duration: 36025000
2015-02-12 14:42:27,673 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:27,674 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50865, dest: /127.0.0.1:50543, bytes: 115052, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034, duration: 37239000
2015-02-12 14:42:27,675 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:27,676 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:27,677 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50864, dest: /127.0.0.1:50546, bytes: 115052, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034, duration: 39941000
2015-02-12 14:42:27,678 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:27,680 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:27,681 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:27,693 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:27,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:27,731 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:42:27,734 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035 src: /127.0.0.1:50867 dest: /127.0.0.1:50543
2015-02-12 14:42:27,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035 src: /127.0.0.1:50868 dest: /127.0.0.1:50546
2015-02-12 14:42:27,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035 src: /127.0.0.1:50869 dest: /127.0.0.1:50549
2015-02-12 14:42:27,746 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50869, dest: /127.0.0.1:50549, bytes: 407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035, duration: 5259000
2015-02-12 14:42:27,747 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:27,748 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50868, dest: /127.0.0.1:50546, bytes: 407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035, duration: 6202000
2015-02-12 14:42:27,748 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:27,749 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50867, dest: /127.0.0.1:50543, bytes: 407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035, duration: 7725000
2015-02-12 14:42:27,749 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:27,749 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:27,750 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:27,751 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:27,753 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003.summary is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:28,173 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:28,173 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0002_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:42:28,174 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000001
2015-02-12 14:42:28,174 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:42:28,174 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0002_000001 released container container_1423780884992_0002_01_000001 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:42:28,174 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:28,173 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0002_000001
2015-02-12 14:42:28,175 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:28,175 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000002
2015-02-12 14:42:28,175 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:42:28,175 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0002_000001
2015-02-12 14:42:28,176 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0002_000001 State change from FINISHING to FINISHED
2015-02-12 14:42:28,176 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0002 State change from FINISHING to FINISHED
2015-02-12 14:42:28,176 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0002_000001 is done. finalState=FINISHED
2015-02-12 14:42:28,176 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0002 requests cleared
2015-02-12 14:42:28,176 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0002
2015-02-12 14:42:28,177 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0002_000001
2015-02-12 14:42:28,177 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0002,name=[DBD98C85320A4F75B48AA8064AA19438/43DDF72AAA05461EBB45B246E60430B9] lower*upper/(1/1) .../cogroupinner-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0002/jobhistory/job/job_1423780884992_0002,appMasterHost=10.1.1.67,startTime=1423780917703,finishTime=1423780941413,finalStatus=SUCCEEDED
2015-02-12 14:42:28,180 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0002_000001 (auth:SIMPLE)
2015-02-12 14:42:28,182 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0002_01_000001
2015-02-12 14:42:28,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0002 CONTAINERID=container_1423780884992_0002_01_000001
2015-02-12 14:42:28,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0002_01_000001]
2015-02-12 14:42:28,183 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:28,183 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:28,183 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:28,184 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:28,184 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000003
2015-02-12 14:42:28,184 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,184 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0002
2015-02-12 14:42:28,184 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:28,185 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0002, with delay of 10800 seconds
2015-02-12 14:42:28,184 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:42:28,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,186 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 14:42:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 14:42:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 14:42:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 14:42:28,391 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 14:42:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741845 for deletion
2015-02-12 14:42:28,391 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 14:42:28,391 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741846 for deletion
2015-02-12 14:42:28,392 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741845
2015-02-12 14:42:28,393 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741846
2015-02-12 14:42:28,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 14:42:28,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 14:42:28,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 14:42:28,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 14:42:28,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 14:42:28,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 14:42:28,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 14:42:28,404 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741845 for deletion
2015-02-12 14:42:28,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 14:42:28,405 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 14:42:28,405 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 14:42:28,405 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741845
2015-02-12 14:42:28,539 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:28,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:28,539 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000004
2015-02-12 14:42:28,539 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:42:28,540 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,540 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,541 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0002
2015-02-12 14:42:28,541 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:28,541 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0002, with delay of 10800 seconds
2015-02-12 14:42:28,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,647 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:28,647 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:28,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,647 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000005
2015-02-12 14:42:28,648 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:42:28,648 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,649 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0002
2015-02-12 14:42:28,649 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:28,649 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,649 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,649 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0002, with delay of 10800 seconds
2015-02-12 14:42:28,808 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:42:28,809 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:28,809 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000006
2015-02-12 14:42:28,809 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:42:28,809 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,810 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,810 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0002
2015-02-12 14:42:28,811 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,811 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0002
2015-02-12 14:42:28,811 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:42:28,812 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0002, with delay of 10800 seconds
2015-02-12 14:42:29,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:29,185 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0003
2015-02-12 14:42:29,185 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:42:29,186 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0003_01_000007 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@29420592
2015-02-12 14:42:29,186 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0003_01_000002
2015-02-12 14:42:29,187 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:29,187 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:29,187 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0003_01_000004
2015-02-12 14:42:29,188 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:29,188 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0003_01_000005
2015-02-12 14:42:29,188 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:29,189 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0003_01_000006
2015-02-12 14:42:29,189 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:29,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:29,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:29,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:29,368 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:29,368 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:29,369 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:29,372 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:29,373 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:29,377 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000002 by user soberoi
2015-02-12 14:42:29,378 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000006 by user soberoi
2015-02-12 14:42:29,378 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0003
2015-02-12 14:42:29,378 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000002 to application application_1423780884992_0003
2015-02-12 14:42:29,378 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000006
2015-02-12 14:42:29,378 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:42:29,379 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,379 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,379 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:29,379 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:29,378 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000002
2015-02-12 14:42:29,379 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from NEW to INITING
2015-02-12 14:42:29,379 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000006 to application application_1423780884992_0003
2015-02-12 14:42:29,380 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from INITING to RUNNING
2015-02-12 14:42:29,380 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:29,380 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:42:29,380 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,380 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,380 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:29,381 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:29,381 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:29,381 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:29,381 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000006
2015-02-12 14:42:29,389 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000005 by user soberoi
2015-02-12 14:42:29,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0003
2015-02-12 14:42:29,390 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000005
2015-02-12 14:42:29,392 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from NEW to INITING
2015-02-12 14:42:29,392 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000005 to application application_1423780884992_0003
2015-02-12 14:42:29,392 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from INITING to RUNNING
2015-02-12 14:42:29,393 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:42:29,393 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,393 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,393 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:29,393 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:29,394 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:29,394 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:29,394 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000005
2015-02-12 14:42:29,402 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0003_01_000006.tokens. Credentials list:
2015-02-12 14:42:29,416 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0003_01_000005.tokens. Credentials list:
2015-02-12 14:42:29,424 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000004 by user soberoi
2015-02-12 14:42:29,424 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0003
2015-02-12 14:42:29,424 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000004
2015-02-12 14:42:29,424 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from NEW to INITING
2015-02-12 14:42:29,424 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000004 to application application_1423780884992_0003
2015-02-12 14:42:29,425 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from INITING to RUNNING
2015-02-12 14:42:29,425 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:42:29,425 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,425 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,425 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:29,425 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:29,425 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:29,426 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:29,427 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000004
2015-02-12 14:42:29,434 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000003 by user soberoi
2015-02-12 14:42:29,435 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000003
2015-02-12 14:42:29,435 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000003 to application application_1423780884992_0003
2015-02-12 14:42:29,437 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:42:29,437 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,437 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:29,438 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:29,438 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:29,440 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:29,448 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:29,448 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:29,465 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0003_01_000004.tokens. Credentials list:
2015-02-12 14:42:29,537 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:29,538 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:29,542 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:29,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:29,543 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000008
2015-02-12 14:42:29,543 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:42:29,648 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:29,649 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:29,649 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000009
2015-02-12 14:42:29,650 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:42:29,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:29,712 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:29,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:29,792 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000002/default_container_executor.sh]
2015-02-12 14:42:29,814 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:29,815 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:29,815 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000010
2015-02-12 14:42:29,815 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:42:29,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000003/default_container_executor.sh]
2015-02-12 14:42:29,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0003_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000006.tokens
2015-02-12 14:42:29,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:29,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0003_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000005.tokens
2015-02-12 14:42:29,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:30,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0003_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000004.tokens
2015-02-12 14:42:30,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:30,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:30,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:30,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:30,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:30,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:30,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:30,185 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:30,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:30,186 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0003_000001 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096
2015-02-12 14:42:30,186 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0003 unreserved on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:42:30,186 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0003
2015-02-12 14:42:30,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000011 Container Transitioned from NEW to RESERVED
2015-02-12 14:42:30,186 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0003_01_000011 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@29420592
2015-02-12 14:42:30,205 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:30,205 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:30,206 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:30,227 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:30,231 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:30,237 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:30,238 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000008 by user soberoi
2015-02-12 14:42:30,238 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000010 by user soberoi
2015-02-12 14:42:30,238 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000008
2015-02-12 14:42:30,238 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000010
2015-02-12 14:42:30,239 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000008 to application application_1423780884992_0003
2015-02-12 14:42:30,239 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:42:30,239 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:30,239 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:30,239 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:30,239 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:30,239 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000010 to application application_1423780884992_0003
2015-02-12 14:42:30,240 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000008
2015-02-12 14:42:30,240 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 14:42:30,240 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:30,240 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:30,240 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:30,240 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:30,241 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000010
2015-02-12 14:42:30,247 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000009 by user soberoi
2015-02-12 14:42:30,248 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000009
2015-02-12 14:42:30,248 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000009 to application application_1423780884992_0003
2015-02-12 14:42:30,248 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:42:30,248 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:30,249 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:30,249 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:30,249 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:30,249 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0003_01_000009
2015-02-12 14:42:30,278 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0003_01_000008.tokens. Credentials list:
2015-02-12 14:42:30,278 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0003_01_000010.tokens. Credentials list:
2015-02-12 14:42:30,293 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0003_01_000009.tokens. Credentials list:
2015-02-12 14:42:30,319 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:30,336 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:30,348 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:30,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:30,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:30,377 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028
2015-02-12 14:42:30,378 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024
2015-02-12 14:42:30,379 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026
2015-02-12 14:42:30,379 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027
2015-02-12 14:42:30,380 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025
2015-02-12 14:42:30,381 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029
2015-02-12 14:42:30,381 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032
2015-02-12 14:42:30,382 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031
2015-02-12 14:42:30,383 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030
2015-02-12 14:42:30,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:30,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:30,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:30,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:30,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0003/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:30,523 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:30,523 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:30,535 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031
2015-02-12 14:42:30,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030
2015-02-12 14:42:30,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:30,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000012 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:30,544 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000012
2015-02-12 14:42:30,544 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000012 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:42:30,569 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:30,569 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:30,569 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:30,573 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:30,574 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:30,575 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:30,593 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:30,593 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:30,648 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:30,649 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000013 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:30,649 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000013
2015-02-12 14:42:30,649 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000013 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:42:30,675 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:30,675 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:30,688 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:30,688 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:30,696 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:30,696 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:30,698 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:30,698 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:30,713 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:30,714 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:30,737 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026
2015-02-12 14:42:30,738 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033
2015-02-12 14:42:30,738 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023
2015-02-12 14:42:30,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024
2015-02-12 14:42:30,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032
2015-02-12 14:42:30,762 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031
2015-02-12 14:42:30,762 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029
2015-02-12 14:42:30,763 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023
2015-02-12 14:42:30,765 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030
2015-02-12 14:42:30,765 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027
2015-02-12 14:42:30,814 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:30,814 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000014 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:30,814 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000014
2015-02-12 14:42:30,815 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000014 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:42:30,965 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025
2015-02-12 14:42:30,966 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028
2015-02-12 14:42:30,968 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033
2015-02-12 14:42:31,033 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000009/default_container_executor.sh]
2015-02-12 14:42:31,042 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741851_1027
2015-02-12 14:42:31,043 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741852_1028
2015-02-12 14:42:31,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741850_1026
2015-02-12 14:42:31,046 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741847_1023
2015-02-12 14:42:31,046 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741856_1032
2015-02-12 14:42:31,048 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741857_1033
2015-02-12 14:42:31,048 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741848_1024
2015-02-12 14:42:31,050 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741849_1025
2015-02-12 14:42:31,051 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741853_1029
2015-02-12 14:42:31,053 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741855_1031
2015-02-12 14:42:31,060 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000005/default_container_executor.sh]
2015-02-12 14:42:31,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000008/default_container_executor.sh]
2015-02-12 14:42:31,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000004/default_container_executor.sh]
2015-02-12 14:42:31,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000010/default_container_executor.sh]
2015-02-12 14:42:31,099 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000006/default_container_executor.sh]
2015-02-12 14:42:31,186 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0003_000001 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096
2015-02-12 14:42:31,186 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0003 unreserved on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:42:31,186 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0003
2015-02-12 14:42:31,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000015 Container Transitioned from NEW to RESERVED
2015-02-12 14:42:31,186 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0003_01_000015 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@29420592
2015-02-12 14:42:31,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000012 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:31,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000013 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:31,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000014 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:31,221 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:31,224 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000012 by user soberoi
2015-02-12 14:42:31,224 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000012
2015-02-12 14:42:31,224 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000012 to application application_1423780884992_0003
2015-02-12 14:42:31,224 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000012 transitioned from NEW to LOCALIZING
2015-02-12 14:42:31,225 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:31,225 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:31,225 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:31,225 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:31,225 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000012 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:31,283 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000012 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:31,283 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:31,446 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741854_1030
2015-02-12 14:42:31,549 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000012 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:31,550 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000016 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:31,551 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000016
2015-02-12 14:42:31,551 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000016 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 14:42:31,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:31,568 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000012/default_container_executor.sh]
2015-02-12 14:42:31,612 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:31,629 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:31,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0003_01_000009.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000009.tokens
2015-02-12 14:42:31,781 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:31,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0003_01_000010.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000010.tokens
2015-02-12 14:42:31,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:31,827 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0003_01_000008.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000008.tokens
2015-02-12 14:42:31,828 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:42:32,189 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0003_000001 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096
2015-02-12 14:42:32,189 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0003 unreserved on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:42:32,219 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000013 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:42:32,220 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000013 in state: RELEASED event:RELEASED
2015-02-12 14:42:32,220 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000013
2015-02-12 14:42:32,220 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000013 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:42:32,220 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000013 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:42:32,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000014 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:42:32,220 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000014 in state: RELEASED event:RELEASED
2015-02-12 14:42:32,221 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000014
2015-02-12 14:42:32,221 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000014 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:42:32,221 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000014 on node: host: 10.1.1.67:50571 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:42:32,222 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:42:32,222 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000016 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:32,654 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0003_01_000013
2015-02-12 14:42:32,822 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0003_01_000014
2015-02-12 14:42:33,230 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000016 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:42:33,230 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000016 in state: RELEASED event:RELEASED
2015-02-12 14:42:33,231 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000016
2015-02-12 14:42:33,231 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000016 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 14:42:33,231 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000016 on node: host: 10.1.1.67:50579 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 14:42:33,555 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0003_01_000016
2015-02-12 14:42:35,388 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034
2015-02-12 14:42:35,389 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035
2015-02-12 14:42:35,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034
2015-02-12 14:42:35,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035
2015-02-12 14:42:36,450 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741858_1034
2015-02-12 14:42:36,450 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741859_1035
2015-02-12 14:42:39,511 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 14:42:39,511 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:42:46,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:46,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:47,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:42:47,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:42:48,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:42:48,257 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:48,260 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000002
2015-02-12 14:42:48,260 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000002
2015-02-12 14:42:48,260 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:42:48,261 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000002
2015-02-12 14:42:48,290 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000002 is : 143
2015-02-12 14:42:48,300 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:42:48,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036 src: /127.0.0.1:50930 dest: /127.0.0.1:50546
2015-02-12 14:42:48,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036 src: /127.0.0.1:50931 dest: /127.0.0.1:50543
2015-02-12 14:42:48,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036 src: /127.0.0.1:50932 dest: /127.0.0.1:50539
2015-02-12 14:42:48,333 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:48,333 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist for DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:48,334 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000002
2015-02-12 14:42:48,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000002
2015-02-12 14:42:48,336 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000002
2015-02-12 14:42:48,337 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000002
2015-02-12 14:42:48,338 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000002
2015-02-12 14:42:48,338 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:48,339 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000002 from application application_1423780884992_0003
2015-02-12 14:42:48,339 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:48,339 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:48,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:42:48,384 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:48,387 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000003
2015-02-12 14:42:48,388 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000003
2015-02-12 14:42:48,389 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:48,389 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:42:48,389 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000002
2015-02-12 14:42:48,389 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:42:48,390 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000002 on node: host: 10.1.1.67:50583 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:42:48,390 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:42:48,391 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000003
2015-02-12 14:42:48,409 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000003 is : 143
2015-02-12 14:42:48,431 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:48,433 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000003
2015-02-12 14:42:48,434 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000003
2015-02-12 14:42:48,435 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000003
2015-02-12 14:42:48,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000003
2015-02-12 14:42:48,436 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000003
2015-02-12 14:42:48,437 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:48,437 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000003 from application application_1423780884992_0003
2015-02-12 14:42:48,437 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:48,437 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:48,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:42:48,571 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:48,574 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000004
2015-02-12 14:42:48,574 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000004
2015-02-12 14:42:48,574 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:42:48,574 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000004
2015-02-12 14:42:48,594 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000004 is : 143
2015-02-12 14:42:48,606 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:48,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000004
2015-02-12 14:42:48,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000004
2015-02-12 14:42:48,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000004
2015-02-12 14:42:48,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000004
2015-02-12 14:42:48,610 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000004
2015-02-12 14:42:48,611 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:48,611 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000004 from application application_1423780884992_0003
2015-02-12 14:42:48,611 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:48,611 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:48,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:42:48,774 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:48,775 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000008
2015-02-12 14:42:48,776 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000008
2015-02-12 14:42:48,776 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:42:48,776 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000008
2015-02-12 14:42:48,777 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:48,777 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:42:48,777 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000004
2015-02-12 14:42:48,777 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:42:48,777 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000004 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 14:42:48,798 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000008 is : 143
2015-02-12 14:42:48,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000006_0 dst=null perm=null proto=rpc
2015-02-12 14:42:48,852 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:48,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000009
2015-02-12 14:42:48,858 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000009
2015-02-12 14:42:48,858 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:42:48,858 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000009
2015-02-12 14:42:48,873 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:48,874 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000008
2015-02-12 14:42:48,875 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000008
2015-02-12 14:42:48,876 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000009 is : 143
2015-02-12 14:42:48,879 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000008
2015-02-12 14:42:48,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000008
2015-02-12 14:42:48,883 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000008
2015-02-12 14:42:48,883 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:48,883 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000008 from application application_1423780884992_0003
2015-02-12 14:42:48,884 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:48,884 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:48,893 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:48,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000009
2015-02-12 14:42:48,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000009
2015-02-12 14:42:48,896 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000009
2015-02-12 14:42:48,897 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000009
2015-02-12 14:42:48,897 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000009
2015-02-12 14:42:48,898 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:48,902 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000009 from application application_1423780884992_0003
2015-02-12 14:42:48,903 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:48,903 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:48,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:42:48,930 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:48,933 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000005
2015-02-12 14:42:48,933 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000005
2015-02-12 14:42:48,933 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:42:48,934 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000005
2015-02-12 14:42:48,934 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:48,934 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:42:48,935 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000009
2015-02-12 14:42:48,935 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:42:48,935 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000009 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:42:48,962 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000005 is : 143
2015-02-12 14:42:48,982 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:48,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000005
2015-02-12 14:42:48,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000005
2015-02-12 14:42:48,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000005
2015-02-12 14:42:48,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000005
2015-02-12 14:42:48,984 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000005
2015-02-12 14:42:48,984 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:48,985 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000005 from application application_1423780884992_0003
2015-02-12 14:42:48,985 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:48,985 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:49,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:42:49,034 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:49,036 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000006
2015-02-12 14:42:49,037 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000006
2015-02-12 14:42:49,037 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:42:49,037 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000006
2015-02-12 14:42:49,055 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000006 is : 143
2015-02-12 14:42:49,070 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:49,072 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000006
2015-02-12 14:42:49,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000006
2015-02-12 14:42:49,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000006
2015-02-12 14:42:49,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000006
2015-02-12 14:42:49,077 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000006
2015-02-12 14:42:49,078 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:49,078 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000006 from application application_1423780884992_0003
2015-02-12 14:42:49,078 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:49,079 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:49,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000007_0 dst=null perm=null proto=rpc
2015-02-12 14:42:49,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_m_000008_0 dst=null perm=null proto=rpc
2015-02-12 14:42:49,152 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:49,155 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000010
2015-02-12 14:42:49,155 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000010
2015-02-12 14:42:49,156 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000010 transitioned from RUNNING to KILLING
2015-02-12 14:42:49,157 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:49,157 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:42:49,157 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000006
2015-02-12 14:42:49,158 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:42:49,158 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:42:49,157 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000010
2015-02-12 14:42:49,178 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000010 is : 143
2015-02-12 14:42:49,192 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:49,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000010
2015-02-12 14:42:49,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000010
2015-02-12 14:42:49,193 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000010
2015-02-12 14:42:49,193 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000010
2015-02-12 14:42:49,193 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:49,193 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000010 from application application_1423780884992_0003
2015-02-12 14:42:49,193 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:49,193 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:49,193 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000010
2015-02-12 14:42:49,227 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:49,230 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000012
2015-02-12 14:42:49,230 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000012
2015-02-12 14:42:49,230 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000012 transitioned from RUNNING to KILLING
2015-02-12 14:42:49,231 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000012
2015-02-12 14:42:49,231 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:49,232 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:49,232 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:42:49,232 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000008
2015-02-12 14:42:49,232 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:42:49,232 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000008 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:42:49,254 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000012 is : 143
2015-02-12 14:42:49,266 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000012 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:49,266 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000012
2015-02-12 14:42:49,267 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000012
2015-02-12 14:42:49,267 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000012
2015-02-12 14:42:49,267 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000012
2015-02-12 14:42:49,268 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000012
2015-02-12 14:42:49,269 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000012 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:49,269 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000012 from application application_1423780884992_0003
2015-02-12 14:42:49,269 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:49,269 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:49,406 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:49,409 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:49,410 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:42:49,410 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000003
2015-02-12 14:42:49,410 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:42:49,410 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000003 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:42:49,411 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000017 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:49,411 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000017
2015-02-12 14:42:49,411 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0003_01_000017 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:42:49,939 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:49,940 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:42:49,940 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000005
2015-02-12 14:42:49,940 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:49,940 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000005 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:49,940 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,158 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,158 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:50,158 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 14:42:50,158 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000010
2015-02-12 14:42:50,159 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:50,159 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000010 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:50,235 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,236 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,236 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000012 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:50,236 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000012 in state: COMPLETED event:FINISHED
2015-02-12 14:42:50,236 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000012
2015-02-12 14:42:50,236 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000012 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:42:50,236 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000012 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:42:50,335 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000017 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:50,345 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:50,348 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0003_01_000017 by user soberoi
2015-02-12 14:42:50,349 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000017
2015-02-12 14:42:50,349 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0003_01_000017 to application application_1423780884992_0003
2015-02-12 14:42:50,349 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000017 transitioned from NEW to LOCALIZING
2015-02-12 14:42:50,349 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0003
2015-02-12 14:42:50,349 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0003
2015-02-12 14:42:50,349 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:42:50,350 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0003
2015-02-12 14:42:50,350 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000017 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:50,383 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000017 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:50,383 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:50,403 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000002]
2015-02-12 14:42:50,404 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000017 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:50,404 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,404 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,492 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000017/default_container_executor.sh]
2015-02-12 14:42:50,942 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000009]
2015-02-12 14:42:50,942 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:50,942 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,162 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000006]
2015-02-12 14:42:51,162 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,163 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,239 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000008, container_1423780884992_0003_01_000004]
2015-02-12 14:42:51,239 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,240 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,240 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,340 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:42:51,405 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000003]
2015-02-12 14:42:51,405 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:51,943 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000005]
2015-02-12 14:42:51,943 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:52,168 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000010]
2015-02-12 14:42:52,168 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:52,241 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000012]
2015-02-12 14:42:52,241 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:52,962 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:52,967 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:52,971 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:52,973 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:52,983 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:52,986 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:42:53,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,274 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:42:53,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037 src: /127.0.0.1:50951 dest: /127.0.0.1:50543
2015-02-12 14:42:53,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037 src: /127.0.0.1:50952 dest: /127.0.0.1:50539
2015-02-12 14:42:53,372 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037 src: /127.0.0.1:50953 dest: /127.0.0.1:50549
2015-02-12 14:42:53,410 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50953, dest: /127.0.0.1:50549, bytes: 66, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0003_r_000000_0_-1514284908_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037, duration: 36451000
2015-02-12 14:42:53,410 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:53,411 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,411 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50952, dest: /127.0.0.1:50539, bytes: 66, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0003_r_000000_0_-1514284908_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037, duration: 37760000
2015-02-12 14:42:53,411 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,412 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50951, dest: /127.0.0.1:50543, bytes: 66, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0003_r_000000_0_-1514284908_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037, duration: 38741000
2015-02-12 14:42:53,412 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:53,412 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,414 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:53,420 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0003_r_000000_0_-1514284908_1
2015-02-12 14:42:53,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:42:53,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:42:53,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/task_1423780884992_0003_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:42:53,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/_temporary/attempt_1423780884992_0003_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/task_1423780884992_0003_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:42:53,464 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:42:53,466 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000017
2015-02-12 14:42:53,467 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000017
2015-02-12 14:42:53,467 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000017 transitioned from RUNNING to KILLING
2015-02-12 14:42:53,467 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000017
2015-02-12 14:42:53,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,487 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,494 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0003_01_000017 is : 143
2015-02-12 14:42:53,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:42:53,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:53,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:53,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/task_1423780884992_0003_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:42:53,510 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000017 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:42:53,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:53,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000017
2015-02-12 14:42:53,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000017
2015-02-12 14:42:53,511 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000017
2015-02-12 14:42:53,512 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000017 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:42:53,512 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000017 from application application_1423780884992_0003
2015-02-12 14:42:53,512 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:53,513 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:53,514 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000017
2015-02-12 14:42:53,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000017
2015-02-12 14:42:53,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary/1/task_1423780884992_0003_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary dst=null perm=null proto=rpc
2015-02-12 14:42:53,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,538 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,542 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,563 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50932, dest: /127.0.0.1:50539, bytes: 98214, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036, duration: 5251418000
2015-02-12 14:42:53,564 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:53,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 18998
2015-02-12 14:42:53,566 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50931, dest: /127.0.0.1:50543, bytes: 98214, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036, duration: 5245098000
2015-02-12 14:42:53,566 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,568 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 18998
2015-02-12 14:42:53,568 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50930, dest: /127.0.0.1:50546, bytes: 98214, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036, duration: 5254640000
2015-02-12 14:42:53,570 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,574 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741860_1036 size 98214
2015-02-12 14:42:53,574 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,586 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:42:53,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038 src: /127.0.0.1:50955 dest: /127.0.0.1:50543
2015-02-12 14:42:53,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038 src: /127.0.0.1:50956 dest: /127.0.0.1:50546
2015-02-12 14:42:53,594 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038 src: /127.0.0.1:50957 dest: /127.0.0.1:50539
2015-02-12 14:42:53,602 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50957, dest: /127.0.0.1:50539, bytes: 468, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038, duration: 5414000
2015-02-12 14:42:53,602 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:53,603 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50956, dest: /127.0.0.1:50546, bytes: 468, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038, duration: 5486000
2015-02-12 14:42:53,604 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,607 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,608 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50955, dest: /127.0.0.1:50543, bytes: 468, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038, duration: 9391000
2015-02-12 14:42:53,609 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,611 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,613 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741862_1038 size 468
2015-02-12 14:42:53,613 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:53,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:42:53,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:53,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:42:53,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:53,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:42:53,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,650 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:42:53,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039 src: /127.0.0.1:50959 dest: /127.0.0.1:50539
2015-02-12 14:42:53,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039 src: /127.0.0.1:50960 dest: /127.0.0.1:50543
2015-02-12 14:42:53,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039 src: /127.0.0.1:50961 dest: /127.0.0.1:50549
2015-02-12 14:42:53,660 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50961, dest: /127.0.0.1:50549, bytes: 98214, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039, duration: 2177000
2015-02-12 14:42:53,660 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:53,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,662 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50960, dest: /127.0.0.1:50543, bytes: 98214, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039, duration: 3678000
2015-02-12 14:42:53,663 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,663 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,664 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50959, dest: /127.0.0.1:50539, bytes: 98214, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039, duration: 5872000
2015-02-12 14:42:53,664 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,666 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,668 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:53,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:42:53,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:53,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:42:53,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:42:53,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003/job_1423780884992_0003_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:42:53,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:53,691 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:42:53,694 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040 src: /127.0.0.1:50963 dest: /127.0.0.1:50539
2015-02-12 14:42:53,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040 src: /127.0.0.1:50964 dest: /127.0.0.1:50543
2015-02-12 14:42:53,699 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040 src: /127.0.0.1:50965 dest: /127.0.0.1:50546
2015-02-12 14:42:53,704 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50965, dest: /127.0.0.1:50546, bytes: 115052, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040, duration: 2343000
2015-02-12 14:42:53,704 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:53,706 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50964, dest: /127.0.0.1:50543, bytes: 115052, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040, duration: 4296000
2015-02-12 14:42:53,707 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,707 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:42:53,708 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:53,709 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50963, dest: /127.0.0.1:50539, bytes: 115052, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-110509062_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040, duration: 7024000
2015-02-12 14:42:53,710 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:53,711 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:53,714 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-110509062_1
2015-02-12 14:42:53,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:53,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:53,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:53,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:42:53,737 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0003_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:42:53,737 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:42:53,737 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0003 with final state: FINISHING
2015-02-12 14:42:53,737 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from RUNNING to FINAL_SAVING
2015-02-12 14:42:53,737 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0003
2015-02-12 14:42:53,739 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:42:53,739 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from FINAL_SAVING to FINISHING
2015-02-12 14:42:54,469 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000017 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:42:54,469 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000017 in state: COMPLETED event:FINISHED
2015-02-12 14:42:54,469 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000017
2015-02-12 14:42:54,470 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000017 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:42:54,470 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000017 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:42:54,741 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0003 unregistered successfully.
2015-02-12 14:42:54,745 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:42:54,746 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:42:54,746 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:42:54,746 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741857_1033 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:42:54,747 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741859_1035 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:42:54,747 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741860_1036 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:42:54,747 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:42:54,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0003 dst=null perm=null proto=rpc
2015-02-12 14:42:54,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,785 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary
2015-02-12 14:42:54,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/_temporary dst=null perm=null proto=rpc
2015-02-12 14:42:54,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,813 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:54,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:54,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,839 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:54,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:54,845 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed
2015-02-12 14:42:54,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed dst=null perm=null proto=rpc
2015-02-12 14:42:54,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:54,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupmixed/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:42:54,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,872 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:42:54,873 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:42:54,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:42:54,898 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:42:54,899 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:42:54,899 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:42:54,899 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter"]
2015-02-12 14:42:54,899 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:42:54,899 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:42:54,899 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:42:54,900 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ipesplatform/cogroupouter
2015-02-12 14:42:54,912 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:42:54,929 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:42:54,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:42:54,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:54,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:54,940 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 4
2015-02-12 14:42:54,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004 dst=null perm=null proto=rpc
2015-02-12 14:42:54,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:42:54,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:42:54,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:54,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:54,953 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:42:54,955 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 src: /127.0.0.1:50971 dest: /127.0.0.1:50543
2015-02-12 14:42:54,957 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 src: /127.0.0.1:50972 dest: /127.0.0.1:50549
2015-02-12 14:42:54,958 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 src: /127.0.0.1:50973 dest: /127.0.0.1:50539
2015-02-12 14:42:54,962 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50973, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041, duration: 2279000
2015-02-12 14:42:54,963 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:54,963 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:54,963 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50972, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041, duration: 2975000
2015-02-12 14:42:54,964 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:54,966 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50971, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041, duration: 4596000
2015-02-12 14:42:54,966 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:54,967 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:54,969 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:54,970 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:54,971 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar
2015-02-12 14:42:54,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:54,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:54,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:54,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:54,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:54,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:42:54,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:42:54,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:42:54,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:42:54,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:42:54,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:54,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,991 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:54,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,995 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:54,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:54,998 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:54,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:55,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:55,002 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:42:55,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:42:55,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:55,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:55,009 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split
2015-02-12 14:42:55,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:55,011 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:42:55,013 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042 src: /127.0.0.1:50974 dest: /127.0.0.1:50539
2015-02-12 14:42:55,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042 src: /127.0.0.1:50975 dest: /127.0.0.1:50546
2015-02-12 14:42:55,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042 src: /127.0.0.1:50976 dest: /127.0.0.1:50543
2015-02-12 14:42:55,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042 src: /127.0.0.1:50977 dest: /127.0.0.1:50549
2015-02-12 14:42:55,023 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50977, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, duration: 2098000
2015-02-12 14:42:55,024 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:55,025 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50976, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, duration: 3516000
2015-02-12 14:42:55,026 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,028 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50975, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, duration: 6716000
2015-02-12 14:42:55,029 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,030 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,030 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50974, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, duration: 9278000
2015-02-12 14:42:55,030 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,031 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,033 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,034 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:55,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:55,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:55,044 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:42:55,047 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043 src: /127.0.0.1:50978 dest: /127.0.0.1:50546
2015-02-12 14:42:55,050 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043 src: /127.0.0.1:50979 dest: /127.0.0.1:50539
2015-02-12 14:42:55,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043 src: /127.0.0.1:50980 dest: /127.0.0.1:50549
2015-02-12 14:42:55,059 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50980, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043, duration: 2938000
2015-02-12 14:42:55,060 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:55,061 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50979, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043, duration: 3111000
2015-02-12 14:42:55,061 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,061 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:55,064 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50978, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043, duration: 6007000
2015-02-12 14:42:55,064 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,066 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:42:55,069 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741867_1043 size 183
2015-02-12 14:42:55,069 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:55,070 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:42:55,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:55,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:42:55,089 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:42:55,092 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044 src: /127.0.0.1:50981 dest: /127.0.0.1:50546
2015-02-12 14:42:55,094 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044 src: /127.0.0.1:50982 dest: /127.0.0.1:50539
2015-02-12 14:42:55,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044 src: /127.0.0.1:50983 dest: /127.0.0.1:50543
2015-02-12 14:42:55,098 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50983, dest: /127.0.0.1:50543, bytes: 97914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044, duration: 1813000
2015-02-12 14:42:55,099 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:55,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,100 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50982, dest: /127.0.0.1:50539, bytes: 97914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044, duration: 3130000
2015-02-12 14:42:55,100 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,101 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50981, dest: /127.0.0.1:50546, bytes: 97914, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044, duration: 4345000
2015-02-12 14:42:55,101 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,102 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:55,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:55,106 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:42:55,107 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0004
2015-02-12 14:42:55,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004 dst=null perm=null proto=rpc
2015-02-12 14:42:55,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:55,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:55,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:55,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:55,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:55,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:55,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,126 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 4 submitted by user soberoi
2015-02-12 14:42:55,126 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0004
2015-02-12 14:42:55,126 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0004
2015-02-12 14:42:55,126 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from NEW to NEW_SAVING
2015-02-12 14:42:55,127 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0004
2015-02-12 14:42:55,127 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:42:55,127 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0004 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:42:55,128 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from SUBMITTED to ACCEPTED
2015-02-12 14:42:55,128 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0004_000001
2015-02-12 14:42:55,128 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0004
2015-02-12 14:42:55,128 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from NEW to SUBMITTED
2015-02-12 14:42:55,129 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0004_000001 to scheduler from user: soberoi
2015-02-12 14:42:55,131 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:42:55,134 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0004/
2015-02-12 14:42:55,135 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0004
2015-02-12 14:42:55,135 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0004/
2015-02-12 14:42:55,173 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:42:55,173 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000001
2015-02-12 14:42:55,173 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:42:55,174 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0004_01_000001
2015-02-12 14:42:55,174 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:42:55,175 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0004_000001
2015-02-12 14:42:55,175 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0004 AttemptId: appattempt_1423780884992_0004_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0004_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:42:55,175 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:42:55,176 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:42:55,177 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0004_000001
2015-02-12 14:42:55,179 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0004_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0004_000001
2015-02-12 14:42:55,179 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:42:55,179 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0004_000001
2015-02-12 14:42:55,179 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0004_000001
2015-02-12 14:42:55,183 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:42:55,186 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000001 by user soberoi
2015-02-12 14:42:55,186 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0004
2015-02-12 14:42:55,187 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000001
2015-02-12 14:42:55,187 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from NEW to INITING
2015-02-12 14:42:55,187 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000001 to application application_1423780884992_0004
2015-02-12 14:42:55,187 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from INITING to RUNNING
2015-02-12 14:42:55,187 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0004_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0004_000001
2015-02-12 14:42:55,187 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:42:55,187 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:42:55,188 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:42:55,188 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:42:55,188 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:42:55,188 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:42:55,189 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:42:55,190 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0004_01_000001
2015-02-12 14:42:55,206 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0004_01_000001.tokens. Credentials list:
2015-02-12 14:42:55,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:42:55,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000001.tokens
2015-02-12 14:42:55,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:42:55,474 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:55,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:42:55,556 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:55,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:55,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:55,620 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0004/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:55,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:55,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:42:55,689 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0004/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:55,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:55,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:42:55,754 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:42:55,754 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:42:55,795 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:42:55,795 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:55,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000001/default_container_executor.sh]
2015-02-12 14:42:56,173 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:42:56,478 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:57,483 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:57,560 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073741865_1041 to datanode(s) 127.0.0.1:50546
2015-02-12 14:42:57,561 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741859_1035, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 14:42:57,561 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741857_1033, blk_1073741860_1036, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 14:42:57,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:42:57,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:42:57,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:42:57,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:42:57,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004 dst=null perm=null proto=rpc
2015-02-12 14:42:57,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:42:57,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:42:58,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:58,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:42:58,410 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 to 127.0.0.1:50546
2015-02-12 14:42:58,410 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 14:42:58,411 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741860 for deletion
2015-02-12 14:42:58,411 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 14:42:58,411 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 14:42:58,411 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 14:42:58,411 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 14:42:58,412 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741860
2015-02-12 14:42:58,412 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 14:42:58,412 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:42:58,413 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 src: /127.0.0.1:50989 dest: /127.0.0.1:50546
2015-02-12 14:42:58,415 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041 src: /127.0.0.1:50989 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:42:58,419 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741865_1041 size 254067
2015-02-12 14:42:58,488 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:59,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741856 for deletion
2015-02-12 14:42:59,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 14:42:59,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741858 for deletion
2015-02-12 14:42:59,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741856
2015-02-12 14:42:59,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741859 for deletion
2015-02-12 14:42:59,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 14:42:59,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 14:42:59,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741859
2015-02-12 14:42:59,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 14:42:59,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 14:42:59,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741858
2015-02-12 14:42:59,059 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 14:42:59,241 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:42:59,245 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0004_000001
2015-02-12 14:42:59,245 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0004 APPATTEMPTID=appattempt_1423780884992_0004_000001
2015-02-12 14:42:59,245 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:42:59,246 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from ACCEPTED to RUNNING
2015-02-12 14:42:59,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:59,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:42:59,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:59,489 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:42:59,678 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:42:59,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045 src: /127.0.0.1:50995 dest: /127.0.0.1:50546
2015-02-12 14:42:59,729 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045 src: /127.0.0.1:50996 dest: /127.0.0.1:50543
2015-02-12 14:42:59,731 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045 src: /127.0.0.1:50997 dest: /127.0.0.1:50539
2015-02-12 14:42:59,769 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50997, dest: /127.0.0.1:50539, bytes: 114629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045, duration: 36970000
2015-02-12 14:42:59,770 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:59,776 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50996, dest: /127.0.0.1:50543, bytes: 114629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045, duration: 42658000
2015-02-12 14:42:59,776 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:59,779 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50995, dest: /127.0.0.1:50546, bytes: 114629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045, duration: 45908000
2015-02-12 14:42:59,779 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:59,781 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:42:59,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:59,791 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:59,798 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:42:59,809 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0003_01_000001 succeeded
2015-02-12 14:42:59,809 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:42:59,810 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0003_01_000001
2015-02-12 14:42:59,837 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000001
2015-02-12 14:42:59,837 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000001
2015-02-12 14:42:59,838 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000001
2015-02-12 14:42:59,843 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003/container_1423780884992_0003_01_000001
2015-02-12 14:42:59,845 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000001
2015-02-12 14:42:59,845 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:42:59,845 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0003_01_000001 from application application_1423780884992_0003
2015-02-12 14:42:59,846 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:42:59,846 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0003
2015-02-12 14:42:59,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:42:59,878 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:42:59,882 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046 src: /127.0.0.1:50998 dest: /127.0.0.1:50539
2015-02-12 14:42:59,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046 src: /127.0.0.1:50999 dest: /127.0.0.1:50543
2015-02-12 14:42:59,885 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046 src: /127.0.0.1:51000 dest: /127.0.0.1:50546
2015-02-12 14:42:59,889 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51000, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046, duration: 1573000
2015-02-12 14:42:59,890 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:42:59,890 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50999, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046, duration: 2241000
2015-02-12 14:42:59,890 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:42:59,891 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:59,891 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:42:59,892 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:50998, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046, duration: 3451000
2015-02-12 14:42:59,892 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:42:59,893 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:42:59,897 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004.summary is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:00,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037
2015-02-12 14:43:00,414 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039
2015-02-12 14:43:00,415 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040
2015-02-12 14:43:00,416 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042
2015-02-12 14:43:00,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:00,490 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0003_000001
2015-02-12 14:43:00,491 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0003_000001
2015-02-12 14:43:00,490 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0003_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:43:00,491 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000001
2015-02-12 14:43:00,491 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:00,491 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0003_000001 State change from FINISHING to FINISHED
2015-02-12 14:43:00,491 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0003_000001 released container container_1423780884992_0003_01_000001 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:00,492 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0003 State change from FINISHING to FINISHED
2015-02-12 14:43:00,492 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:00,492 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0003
2015-02-12 14:43:00,493 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0003,name=[A07C159BD56F40D48674C5E60F31D40A/E4A8C5C81781407F9BF90C24DF9C8B38] loweroffset*upper*lower/(1/1) ...ipesplatform/cogroupmixed,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0003/jobhistory/job/job_1423780884992_0003,appMasterHost=10.1.1.67,startTime=1423780942983,finishTime=1423780973737,finalStatus=SUCCEEDED
2015-02-12 14:43:00,493 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:00,494 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000002
2015-02-12 14:43:00,494 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:00,494 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0003_000001 is done. finalState=FINISHED
2015-02-12 14:43:00,494 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0003_000001
2015-02-12 14:43:00,495 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0003 requests cleared
2015-02-12 14:43:00,503 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0003_000001 (auth:SIMPLE)
2015-02-12 14:43:00,507 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0003_01_000001
2015-02-12 14:43:00,508 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0003 CONTAINERID=container_1423780884992_0003_01_000001
2015-02-12 14:43:00,509 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0003_01_000001]
2015-02-12 14:43:00,509 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:00,509 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:00,509 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:00,509 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000003
2015-02-12 14:43:00,509 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:00,510 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:43:00,510 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,511 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0003
2015-02-12 14:43:00,512 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:00,512 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0003, with delay of 10800 seconds
2015-02-12 14:43:00,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,562 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741859_1035, blk_1073741860_1036, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 14:43:00,563 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741856_1032, blk_1073741858_1034, blk_1073741859_1035, blk_1073741860_1036, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 14:43:00,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036
2015-02-12 14:43:00,621 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038
2015-02-12 14:43:00,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037
2015-02-12 14:43:00,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039
2015-02-12 14:43:00,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038
2015-02-12 14:43:00,754 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040
2015-02-12 14:43:00,754 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042
2015-02-12 14:43:00,817 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041
2015-02-12 14:43:00,819 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044
2015-02-12 14:43:00,955 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041
2015-02-12 14:43:00,956 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043
2015-02-12 14:43:00,972 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:00,972 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:00,972 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000004
2015-02-12 14:43:00,972 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:00,973 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,973 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0003
2015-02-12 14:43:00,973 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,973 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:00,974 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0003, with delay of 10800 seconds
2015-02-12 14:43:00,974 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,974 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:00,997 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043
2015-02-12 14:43:00,998 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044
2015-02-12 14:43:00,998 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741864_1040
2015-02-12 14:43:00,999 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741860_1036
2015-02-12 14:43:01,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741862_1038
2015-02-12 14:43:01,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042
2015-02-12 14:43:01,155 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741868_1044
2015-02-12 14:43:01,181 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:01,181 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:01,182 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000005
2015-02-12 14:43:01,182 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:43:01,182 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,183 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,184 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,184 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,184 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0003
2015-02-12 14:43:01,185 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:01,185 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0003, with delay of 10800 seconds
2015-02-12 14:43:01,261 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:01,263 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:01,263 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,264 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0003
2015-02-12 14:43:01,264 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:01,265 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0003, with delay of 10800 seconds
2015-02-12 14:43:01,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,263 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000006
2015-02-12 14:43:01,265 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:01,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0003
2015-02-12 14:43:01,335 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0004_01_000002
2015-02-12 14:43:01,335 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:01,335 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:01,336 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0004_01_000004
2015-02-12 14:43:01,336 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:01,336 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0004_01_000005
2015-02-12 14:43:01,337 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:01,337 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0004_01_000006
2015-02-12 14:43:01,337 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:01,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:01,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:01,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:01,428 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741856 for deletion
2015-02-12 14:43:01,428 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741858 for deletion
2015-02-12 14:43:01,428 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741859 for deletion
2015-02-12 14:43:01,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741860 for deletion
2015-02-12 14:43:01,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 14:43:01,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741856
2015-02-12 14:43:01,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741859
2015-02-12 14:43:01,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 14:43:01,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741858
2015-02-12 14:43:01,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741860
2015-02-12 14:43:01,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 14:43:01,431 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 14:43:01,469 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041
2015-02-12 14:43:01,470 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741867_1043
2015-02-12 14:43:01,472 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741866_1042
2015-02-12 14:43:01,473 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741861_1037
2015-02-12 14:43:01,498 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:01,498 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:01,499 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:01,499 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:01,500 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:01,504 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000003 by user soberoi
2015-02-12 14:43:01,505 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0004
2015-02-12 14:43:01,505 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000003
2015-02-12 14:43:01,507 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000004 by user soberoi
2015-02-12 14:43:01,508 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0004
2015-02-12 14:43:01,508 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from NEW to INITING
2015-02-12 14:43:01,508 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000003 to application application_1423780884992_0004
2015-02-12 14:43:01,509 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from INITING to RUNNING
2015-02-12 14:43:01,509 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:43:01,509 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,509 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,509 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:01,509 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0004
2015-02-12 14:43:01,510 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:01,510 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:01,510 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0004_01_000003
2015-02-12 14:43:01,508 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000004
2015-02-12 14:43:01,510 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from NEW to INITING
2015-02-12 14:43:01,511 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000004 to application application_1423780884992_0004
2015-02-12 14:43:01,512 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from INITING to RUNNING
2015-02-12 14:43:01,513 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:43:01,513 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,514 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,514 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:01,514 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0004
2015-02-12 14:43:01,516 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:01,516 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:01,517 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0004_01_000004
2015-02-12 14:43:01,510 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000006 by user soberoi
2015-02-12 14:43:01,518 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0004
2015-02-12 14:43:01,519 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000006
2015-02-12 14:43:01,513 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:01,521 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:01,521 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from NEW to INITING
2015-02-12 14:43:01,521 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000006 to application application_1423780884992_0004
2015-02-12 14:43:01,522 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from INITING to RUNNING
2015-02-12 14:43:01,512 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000002 by user soberoi
2015-02-12 14:43:01,523 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000002
2015-02-12 14:43:01,522 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:43:01,524 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,524 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,524 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:01,524 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0004
2015-02-12 14:43:01,525 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:01,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:01,526 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0004_01_000006
2015-02-12 14:43:01,525 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000002 to application application_1423780884992_0004
2015-02-12 14:43:01,528 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:43:01,529 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,529 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,529 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:01,529 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0004
2015-02-12 14:43:01,530 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0004_01_000002
2015-02-12 14:43:01,548 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0004_01_000004.tokens. Credentials list:
2015-02-12 14:43:01,549 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0004_01_000003.tokens. Credentials list:
2015-02-12 14:43:01,550 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000005 by user soberoi
2015-02-12 14:43:01,551 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000005
2015-02-12 14:43:01,552 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000005 to application application_1423780884992_0004
2015-02-12 14:43:01,552 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:43:01,552 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,552 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0004
2015-02-12 14:43:01,552 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:01,552 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0004
2015-02-12 14:43:01,553 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:01,562 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0004_01_000002.tokens. Credentials list:
2015-02-12 14:43:01,563 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0004_01_000006.tokens. Credentials list:
2015-02-12 14:43:01,650 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:01,650 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:01,675 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741863_1039
2015-02-12 14:43:01,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:01,791 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:01,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741856 for deletion
2015-02-12 14:43:01,794 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 14:43:01,794 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741858 for deletion
2015-02-12 14:43:01,794 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741859 for deletion
2015-02-12 14:43:01,795 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741856
2015-02-12 14:43:01,795 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741858
2015-02-12 14:43:01,795 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741860 for deletion
2015-02-12 14:43:01,795 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 14:43:01,796 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 14:43:01,797 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 14:43:01,797 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741859
2015-02-12 14:43:01,797 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741860
2015-02-12 14:43:01,798 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 14:43:01,798 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 14:43:01,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:01,907 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000005/default_container_executor.sh]
2015-02-12 14:43:01,975 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:02,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0004_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000006.tokens
2015-02-12 14:43:02,028 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:02,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000003.tokens
2015-02-12 14:43:02,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:02,055 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000004.tokens
2015-02-12 14:43:02,056 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:02,182 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:02,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:02,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:02,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:02,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:02,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:02,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:02,262 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:02,268 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:02,282 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:02,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:02,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:02,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:02,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:02,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:02,352 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:43:02,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:02,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:02,397 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:02,397 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:02,409 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:02,410 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:02,410 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:02,466 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:02,466 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:02,473 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:02,473 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:02,473 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:02,474 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:02,478 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:02,479 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:02,513 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:02,545 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:02,545 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:02,685 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000006/default_container_executor.sh]
2015-02-12 14:43:02,687 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000002/default_container_executor.sh]
2015-02-12 14:43:02,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000003/default_container_executor.sh]
2015-02-12 14:43:02,816 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000004/default_container_executor.sh]
2015-02-12 14:43:03,442 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:03,601 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000002.tokens
2015-02-12 14:43:03,601 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:05,825 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045
2015-02-12 14:43:05,826 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046
2015-02-12 14:43:06,005 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741865_1041
2015-02-12 14:43:06,005 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046
2015-02-12 14:43:06,160 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045
2015-02-12 14:43:06,160 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741870_1046
2015-02-12 14:43:06,210 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741869_1045
2015-02-12 14:43:09,518 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30007 milliseconds
2015-02-12 14:43:09,518 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:43:10,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:11,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:11,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:11,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:11,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:11,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:11,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:11,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:11,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:11,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:11,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:43:11,939 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:11,941 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000005
2015-02-12 14:43:11,941 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000005
2015-02-12 14:43:11,941 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:43:11,941 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000005
2015-02-12 14:43:11,966 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:43:11,966 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0004_01_000005 is : 143
2015-02-12 14:43:11,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047 src: /127.0.0.1:51051 dest: /127.0.0.1:50549
2015-02-12 14:43:11,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047 src: /127.0.0.1:51052 dest: /127.0.0.1:50539
2015-02-12 14:43:11,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047 src: /127.0.0.1:51053 dest: /127.0.0.1:50543
2015-02-12 14:43:11,985 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:11,986 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist for DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:11,986 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000005
2015-02-12 14:43:11,987 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000005
2015-02-12 14:43:11,987 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:11,988 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000005 from application application_1423780884992_0004
2015-02-12 14:43:11,988 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:11,988 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:11,988 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000005
2015-02-12 14:43:11,988 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000005
2015-02-12 14:43:11,988 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000005
2015-02-12 14:43:12,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:43:12,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:43:12,340 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:12,342 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:12,354 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000003
2015-02-12 14:43:12,354 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000003
2015-02-12 14:43:12,354 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:43:12,354 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000003
2015-02-12 14:43:12,356 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000006
2015-02-12 14:43:12,356 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000006
2015-02-12 14:43:12,356 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:43:12,356 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000006
2015-02-12 14:43:12,380 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0004_01_000006 is : 143
2015-02-12 14:43:12,381 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0004_01_000003 is : 143
2015-02-12 14:43:12,389 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:12,389 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:12,390 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000006
2015-02-12 14:43:12,390 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000006
2015-02-12 14:43:12,390 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000006
2015-02-12 14:43:12,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000006
2015-02-12 14:43:12,390 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000006
2015-02-12 14:43:12,392 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:12,392 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000006 from application application_1423780884992_0004
2015-02-12 14:43:12,392 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:12,392 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:12,394 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000003
2015-02-12 14:43:12,394 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000003
2015-02-12 14:43:12,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000003
2015-02-12 14:43:12,397 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000003
2015-02-12 14:43:12,400 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000003
2015-02-12 14:43:12,400 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:12,400 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000003 from application application_1423780884992_0004
2015-02-12 14:43:12,401 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:12,401 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:12,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:43:12,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:43:12,476 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:12,480 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000002
2015-02-12 14:43:12,480 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000002
2015-02-12 14:43:12,482 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:43:12,483 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000002
2015-02-12 14:43:12,483 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:12,483 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:43:12,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000003
2015-02-12 14:43:12,483 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:43:12,483 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000003 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:43:12,502 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:12,504 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0004_01_000002 is : 143
2015-02-12 14:43:12,504 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000004
2015-02-12 14:43:12,505 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000004
2015-02-12 14:43:12,505 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:43:12,505 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000004
2015-02-12 14:43:12,525 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0004_01_000004 is : 143
2015-02-12 14:43:12,534 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:12,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000002
2015-02-12 14:43:12,538 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000002
2015-02-12 14:43:12,540 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000002
2015-02-12 14:43:12,540 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:12,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000004
2015-02-12 14:43:12,541 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000004
2015-02-12 14:43:12,541 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:12,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000004
2015-02-12 14:43:12,542 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000004 from application application_1423780884992_0004
2015-02-12 14:43:12,542 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:12,542 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:12,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000004
2015-02-12 14:43:12,543 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000004
2015-02-12 14:43:12,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000002
2015-02-12 14:43:12,548 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000002
2015-02-12 14:43:12,548 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:12,549 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000002 from application application_1423780884992_0004
2015-02-12 14:43:12,549 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:12,549 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:12,947 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:12,948 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:43:12,948 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000005
2015-02-12 14:43:12,948 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:43:12,948 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000005 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:43:13,360 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:13,360 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:43:13,360 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000006
2015-02-12 14:43:13,360 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:13,360 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000006 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:13,485 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:13,485 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:43:13,485 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000002
2015-02-12 14:43:13,486 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:13,486 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000002 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:13,486 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:13,487 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:13,487 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000007
2015-02-12 14:43:13,487 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0004_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:13,508 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:13,509 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:43:13,509 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000004
2015-02-12 14:43:13,509 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:13,509 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000004 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:13,950 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:14,363 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:14,412 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:14,422 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:14,425 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0004_01_000007 by user soberoi
2015-02-12 14:43:14,425 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000007
2015-02-12 14:43:14,425 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0004_01_000007 to application application_1423780884992_0004
2015-02-12 14:43:14,425 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:43:14,426 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0004
2015-02-12 14:43:14,426 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0004
2015-02-12 14:43:14,426 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:14,426 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0004
2015-02-12 14:43:14,428 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:14,473 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:14,474 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:14,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0004_01_000003]
2015-02-12 14:43:14,486 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:14,486 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:14,486 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:14,509 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:14,611 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000007/default_container_executor.sh]
2015-02-12 14:43:14,953 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0004_01_000005]
2015-02-12 14:43:14,953 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:15,366 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0004_01_000006]
2015-02-12 14:43:15,366 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:15,417 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:43:15,491 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0004_01_000002]
2015-02-12 14:43:15,491 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:15,510 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0004_01_000004]
2015-02-12 14:43:15,510 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:17,127 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:17,131 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:17,133 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:17,136 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:17,143 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:17,411 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 370 Total time for transactions(ms): 42 Number of transactions batched in Syncs: 0 Number of syncs: 239 SyncTimes(ms): 79 57
2015-02-12 14:43:17,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,482 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:43:17,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048 src: /127.0.0.1:51067 dest: /127.0.0.1:50549
2015-02-12 14:43:17,577 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048 src: /127.0.0.1:51068 dest: /127.0.0.1:50543
2015-02-12 14:43:17,579 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048 src: /127.0.0.1:51069 dest: /127.0.0.1:50539
2015-02-12 14:43:17,610 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51069, dest: /127.0.0.1:50539, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0004_r_000000_0_-990783784_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048, duration: 28924000
2015-02-12 14:43:17,610 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:17,611 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51068, dest: /127.0.0.1:50543, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0004_r_000000_0_-990783784_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048, duration: 29815000
2015-02-12 14:43:17,612 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:17,612 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,615 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51067, dest: /127.0.0.1:50549, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0004_r_000000_0_-990783784_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048, duration: 33709000
2015-02-12 14:43:17,615 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,617 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:17,619 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:17,625 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0004_r_000000_0_-990783784_1
2015-02-12 14:43:17,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:43:17,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:43:17,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/task_1423780884992_0004_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:43:17,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/_temporary/attempt_1423780884992_0004_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/task_1423780884992_0004_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:43:17,675 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:17,677 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000007
2015-02-12 14:43:17,678 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000007
2015-02-12 14:43:17,678 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:43:17,678 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000007
2015-02-12 14:43:17,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,698 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:43:17,712 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0004_01_000007 is : 143
2015-02-12 14:43:17,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:17,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:17,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/task_1423780884992_0004_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:43:17,727 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:17,728 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000007
2015-02-12 14:43:17,728 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:17,728 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000007 from application application_1423780884992_0004
2015-02-12 14:43:17,728 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:17,731 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:17,731 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000007
2015-02-12 14:43:17,732 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000007
2015-02-12 14:43:17,732 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000007
2015-02-12 14:43:17,732 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000007
2015-02-12 14:43:17,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:17,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary/1/task_1423780884992_0004_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary dst=null perm=null proto=rpc
2015-02-12 14:43:17,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,760 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,766 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,796 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51053, dest: /127.0.0.1:50543, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047, duration: 5814781000
2015-02-12 14:43:17,796 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:17,798 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16374
2015-02-12 14:43:17,798 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51052, dest: /127.0.0.1:50539, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047, duration: 5816119000
2015-02-12 14:43:17,798 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,804 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51051, dest: /127.0.0.1:50549, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047, duration: 5821360000
2015-02-12 14:43:17,805 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,805 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16374
2015-02-12 14:43:17,809 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,811 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741871_1047 size 69201
2015-02-12 14:43:17,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,820 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:43:17,824 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049 src: /127.0.0.1:51071 dest: /127.0.0.1:50543
2015-02-12 14:43:17,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049 src: /127.0.0.1:51072 dest: /127.0.0.1:50549
2015-02-12 14:43:17,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049 src: /127.0.0.1:51073 dest: /127.0.0.1:50539
2015-02-12 14:43:17,836 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51073, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049, duration: 2645000
2015-02-12 14:43:17,836 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:17,838 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:43:17,838 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51072, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049, duration: 3916000
2015-02-12 14:43:17,839 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,840 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:43:17,840 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51071, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049, duration: 6342000
2015-02-12 14:43:17,841 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,842 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:43:17,843 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:17,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:43:17,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:17,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:43:17,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:17,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:43:17,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,875 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:43:17,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050 src: /127.0.0.1:51075 dest: /127.0.0.1:50546
2015-02-12 14:43:17,880 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050 src: /127.0.0.1:51076 dest: /127.0.0.1:50539
2015-02-12 14:43:17,882 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050 src: /127.0.0.1:51077 dest: /127.0.0.1:50543
2015-02-12 14:43:17,888 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51077, dest: /127.0.0.1:50543, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050, duration: 2304000
2015-02-12 14:43:17,888 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:17,889 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51076, dest: /127.0.0.1:50539, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050, duration: 2476000
2015-02-12 14:43:17,889 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,889 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:17,890 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51075, dest: /127.0.0.1:50546, bytes: 69201, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050, duration: 4086000
2015-02-12 14:43:17,891 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,892 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:17,892 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:17,894 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:17,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:43:17,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:17,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:43:17,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:17,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004/job_1423780884992_0004_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:43:17,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:17,914 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:43:17,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051 src: /127.0.0.1:51079 dest: /127.0.0.1:50539
2015-02-12 14:43:17,919 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051 src: /127.0.0.1:51080 dest: /127.0.0.1:50546
2015-02-12 14:43:17,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051 src: /127.0.0.1:51081 dest: /127.0.0.1:50543
2015-02-12 14:43:17,929 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51081, dest: /127.0.0.1:50543, bytes: 114629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051, duration: 2628000
2015-02-12 14:43:17,929 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:17,929 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:43:17,930 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51080, dest: /127.0.0.1:50546, bytes: 114629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051, duration: 3220000
2015-02-12 14:43:17,930 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,931 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:43:17,931 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51079, dest: /127.0.0.1:50539, bytes: 114629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1099583412_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051, duration: 4442000
2015-02-12 14:43:17,932 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:17,933 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:43:17,936 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1099583412_1
2015-02-12 14:43:17,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:17,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:17,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:17,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:17,959 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0004_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:43:17,960 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:43:17,960 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0004 with final state: FINISHING
2015-02-12 14:43:17,960 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from RUNNING to FINAL_SAVING
2015-02-12 14:43:17,961 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0004
2015-02-12 14:43:17,962 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:43:17,962 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from FINAL_SAVING to FINISHING
2015-02-12 14:43:18,681 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:18,681 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:43:18,681 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000007
2015-02-12 14:43:18,681 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:18,682 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000007 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:18,968 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0004 unregistered successfully.
2015-02-12 14:43:18,973 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741865_1041 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:43:18,974 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741866_1042 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:43:18,974 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741867_1043 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:43:18,974 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741868_1044 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:43:18,975 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:43:18,975 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:43:18,975 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:43:18,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0004 dst=null perm=null proto=rpc
2015-02-12 14:43:19,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,017 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary
2015-02-12 14:43:19,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/_temporary dst=null perm=null proto=rpc
2015-02-12 14:43:19,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,036 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:19,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:19,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:19,061 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:19,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:19,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,083 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:43:19,083 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:43:19,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:19,103 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:43:19,103 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:43:19,103 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:43:19,103 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup"]
2015-02-12 14:43:19,103 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:43:19,103 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:43:19,104 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:43:19,105 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) .../cogroupouter-resultgroup
2015-02-12 14:43:19,118 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:43:19,131 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:43:19,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:19,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:43:19,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:43:19,140 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 5
2015-02-12 14:43:19,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005 dst=null perm=null proto=rpc
2015-02-12 14:43:19,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:43:19,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:43:19,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,153 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:43:19,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 src: /127.0.0.1:51086 dest: /127.0.0.1:50539
2015-02-12 14:43:19,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 src: /127.0.0.1:51087 dest: /127.0.0.1:50549
2015-02-12 14:43:19,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 src: /127.0.0.1:51088 dest: /127.0.0.1:50543
2015-02-12 14:43:19,163 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51088, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052, duration: 2842000
2015-02-12 14:43:19,163 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:19,164 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51087, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052, duration: 4584000
2015-02-12 14:43:19,165 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,166 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51086, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052, duration: 5507000
2015-02-12 14:43:19,167 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,169 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,170 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741876_1052 size 254067
2015-02-12 14:43:19,170 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:19,172 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar
2015-02-12 14:43:19,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:43:19,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:43:19,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:43:19,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:43:19,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:43:19,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,188 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:19,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,194 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:19,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,200 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:19,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,205 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:19,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:19,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,215 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split
2015-02-12 14:43:19,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:19,217 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:43:19,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053 src: /127.0.0.1:51089 dest: /127.0.0.1:50549
2015-02-12 14:43:19,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053 src: /127.0.0.1:51090 dest: /127.0.0.1:50539
2015-02-12 14:43:19,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053 src: /127.0.0.1:51091 dest: /127.0.0.1:50543
2015-02-12 14:43:19,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053 src: /127.0.0.1:51092 dest: /127.0.0.1:50546
2015-02-12 14:43:19,227 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51092, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, duration: 1571000
2015-02-12 14:43:19,227 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:19,228 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51091, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, duration: 2227000
2015-02-12 14:43:19,228 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,228 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,230 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51090, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, duration: 3448000
2015-02-12 14:43:19,230 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,232 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51089, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, duration: 6196000
2015-02-12 14:43:19,232 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,233 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,236 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:19,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,242 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:43:19,244 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054 src: /127.0.0.1:51093 dest: /127.0.0.1:50546
2015-02-12 14:43:19,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054 src: /127.0.0.1:51094 dest: /127.0.0.1:50549
2015-02-12 14:43:19,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054 src: /127.0.0.1:51095 dest: /127.0.0.1:50543
2015-02-12 14:43:19,250 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51095, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054, duration: 1281000
2015-02-12 14:43:19,251 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:19,251 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,252 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51094, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054, duration: 2045000
2015-02-12 14:43:19,252 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,253 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51093, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054, duration: 3126000
2015-02-12 14:43:19,253 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,253 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:19,258 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:19,259 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:19,259 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:43:19,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:19,304 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:43:19,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055 src: /127.0.0.1:51096 dest: /127.0.0.1:50543
2015-02-12 14:43:19,311 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055 src: /127.0.0.1:51097 dest: /127.0.0.1:50546
2015-02-12 14:43:19,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055 src: /127.0.0.1:51098 dest: /127.0.0.1:50549
2015-02-12 14:43:19,318 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51098, dest: /127.0.0.1:50549, bytes: 97934, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055, duration: 3702000
2015-02-12 14:43:19,319 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:19,320 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,320 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51097, dest: /127.0.0.1:50546, bytes: 97934, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055, duration: 4296000
2015-02-12 14:43:19,320 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,322 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51096, dest: /127.0.0.1:50543, bytes: 97934, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055, duration: 6515000
2015-02-12 14:43:19,322 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:19,322 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,324 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:43:19,326 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:19,327 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0005
2015-02-12 14:43:19,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005 dst=null perm=null proto=rpc
2015-02-12 14:43:19,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:19,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:19,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:19,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:19,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:19,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:19,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,364 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 5 submitted by user soberoi
2015-02-12 14:43:19,364 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0005
2015-02-12 14:43:19,364 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0005
2015-02-12 14:43:19,365 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0005
2015-02-12 14:43:19,364 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from NEW to NEW_SAVING
2015-02-12 14:43:19,365 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:43:19,365 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0005 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:43:19,365 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from SUBMITTED to ACCEPTED
2015-02-12 14:43:19,366 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0005_000001
2015-02-12 14:43:19,366 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from NEW to SUBMITTED
2015-02-12 14:43:19,366 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0005_000001 to scheduler from user: soberoi
2015-02-12 14:43:19,367 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:43:19,367 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0005
2015-02-12 14:43:19,369 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0005/
2015-02-12 14:43:19,369 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0005
2015-02-12 14:43:19,369 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0005/
2015-02-12 14:43:19,374 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:19,375 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000001
2015-02-12 14:43:19,375 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:43:19,375 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0005_01_000001
2015-02-12 14:43:19,375 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:19,375 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0005_000001
2015-02-12 14:43:19,376 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0005 AttemptId: appattempt_1423780884992_0005_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0005_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:43:19,376 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:43:19,376 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:43:19,377 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0005_000001
2015-02-12 14:43:19,378 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0005_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0005_000001
2015-02-12 14:43:19,378 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:43:19,378 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0005_000001
2015-02-12 14:43:19,378 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0005_000001
2015-02-12 14:43:19,383 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:19,387 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000001 by user soberoi
2015-02-12 14:43:19,387 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0005
2015-02-12 14:43:19,387 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000001
2015-02-12 14:43:19,387 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from NEW to INITING
2015-02-12 14:43:19,387 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000001 to application application_1423780884992_0005
2015-02-12 14:43:19,388 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from INITING to RUNNING
2015-02-12 14:43:19,388 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0005_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0005_000001
2015-02-12 14:43:19,388 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:43:19,388 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:43:19,388 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:19,389 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:19,389 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:43:19,389 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:43:19,389 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:19,389 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0005_01_000001
2015-02-12 14:43:19,402 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0005_01_000001.tokens. Credentials list:
2015-02-12 14:43:19,522 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:19,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000001.tokens
2015-02-12 14:43:19,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:19,683 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:19,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:19,762 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:19,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:19,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:19,828 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:19,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:19,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:19,890 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0005/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:19,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:19,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:19,965 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0005/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:19,965 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:20,006 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:20,006 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:20,137 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000001/default_container_executor.sh]
2015-02-12 14:43:20,376 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:20,685 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:21,579 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073741876_1052 to datanode(s) 127.0.0.1:50546
2015-02-12 14:43:21,579 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741865_1041, blk_1073741866_1042, blk_1073741867_1043, blk_1073741871_1047]
2015-02-12 14:43:21,579 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741865_1041, blk_1073741866_1042, blk_1073741867_1043, blk_1073741868_1044, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-02-12 14:43:21,684 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:22,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:43:22,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:43:22,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:43:22,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:43:22,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005 dst=null perm=null proto=rpc
2015-02-12 14:43:22,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:43:22,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:43:22,432 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 to 127.0.0.1:50546
2015-02-12 14:43:22,432 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 14:43:22,433 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 14:43:22,433 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 14:43:22,433 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 14:43:22,433 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 14:43:22,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 14:43:22,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 14:43:22,433 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 14:43:22,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 14:43:22,435 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:43:22,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 14:43:22,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 14:43:22,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 14:43:22,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 src: /127.0.0.1:51106 dest: /127.0.0.1:50546
2015-02-12 14:43:22,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 14:43:22,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 14:43:22,438 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052 src: /127.0.0.1:51106 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:43:22,439 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741876_1052 size 254067
2015-02-12 14:43:22,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:22,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:22,689 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:23,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 14:43:23,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 14:43:23,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 14:43:23,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 14:43:23,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 14:43:23,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 14:43:23,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 14:43:23,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 14:43:23,380 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:23,382 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0005_000001
2015-02-12 14:43:23,382 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0005 APPATTEMPTID=appattempt_1423780884992_0005_000001
2015-02-12 14:43:23,383 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:43:23,383 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from ACCEPTED to RUNNING
2015-02-12 14:43:23,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:23,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:43:23,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:23,690 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:23,789 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:43:23,838 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056 src: /127.0.0.1:51113 dest: /127.0.0.1:50543
2015-02-12 14:43:23,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056 src: /127.0.0.1:51114 dest: /127.0.0.1:50549
2015-02-12 14:43:23,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056 src: /127.0.0.1:51115 dest: /127.0.0.1:50539
2015-02-12 14:43:23,877 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51115, dest: /127.0.0.1:50539, bytes: 114649, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056, duration: 33671000
2015-02-12 14:43:23,877 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:23,878 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:23,878 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51114, dest: /127.0.0.1:50549, bytes: 114649, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056, duration: 34498000
2015-02-12 14:43:23,878 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:23,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:23,879 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51113, dest: /127.0.0.1:50543, bytes: 114649, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056, duration: 35846000
2015-02-12 14:43:23,881 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:23,881 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:23,906 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:23,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:23,941 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:43:23,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057 src: /127.0.0.1:51116 dest: /127.0.0.1:50549
2015-02-12 14:43:23,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057 src: /127.0.0.1:51117 dest: /127.0.0.1:50543
2015-02-12 14:43:23,947 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057 src: /127.0.0.1:51118 dest: /127.0.0.1:50539
2015-02-12 14:43:23,956 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51118, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057, duration: 7276000
2015-02-12 14:43:23,957 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:23,958 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51117, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057, duration: 8622000
2015-02-12 14:43:23,958 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:23,959 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:43:23,959 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:23,959 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51116, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057, duration: 10296000
2015-02-12 14:43:23,960 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:23,960 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:23,965 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005.summary is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:24,021 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0004_01_000001 succeeded
2015-02-12 14:43:24,022 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:43:24,022 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0004_01_000001
2015-02-12 14:43:24,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000001
2015-02-12 14:43:24,045 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000001
2015-02-12 14:43:24,045 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000001
2015-02-12 14:43:24,045 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000001
2015-02-12 14:43:24,046 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:43:24,046 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0004_01_000001 from application application_1423780884992_0004
2015-02-12 14:43:24,047 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:24,047 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0004
2015-02-12 14:43:24,046 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0004/container_1423780884992_0004_01_000001
2015-02-12 14:43:24,536 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:24,536 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000002
2015-02-12 14:43:24,536 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:24,584 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741865_1041, blk_1073741866_1042, blk_1073741868_1044, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-02-12 14:43:24,584 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741865_1041, blk_1073741866_1042, blk_1073741867_1043, blk_1073741868_1044, blk_1073741869_1045, blk_1073741870_1046]
2015-02-12 14:43:24,694 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:24,695 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:24,695 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000003
2015-02-12 14:43:24,695 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:24,985 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:24,985 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0004_000001
2015-02-12 14:43:24,985 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0004_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:43:24,985 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0004_000001
2015-02-12 14:43:24,985 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000001
2015-02-12 14:43:24,986 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:24,986 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0004_000001 released container container_1423780884992_0004_01_000001 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:24,985 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0004_000001 State change from FINISHING to FINISHED
2015-02-12 14:43:24,986 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:24,987 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000004
2015-02-12 14:43:24,987 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:24,987 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0004 State change from FINISHING to FINISHED
2015-02-12 14:43:24,987 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0004_000001 is done. finalState=FINISHED
2015-02-12 14:43:24,987 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0004 requests cleared
2015-02-12 14:43:24,988 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0004
2015-02-12 14:43:24,988 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0004,name=[DB86A6863A8A403DB9E89675C167035F/6C5F38712FB040D9853166E8499BE8BB] lower*upper/(1/1) ...ipesplatform/cogroupouter,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0004/jobhistory/job/job_1423780884992_0004,appMasterHost=10.1.1.67,startTime=1423780975126,finishTime=1423780997960,finalStatus=SUCCEEDED
2015-02-12 14:43:24,988 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0004_000001
2015-02-12 14:43:24,991 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0004_000001 (auth:SIMPLE)
2015-02-12 14:43:24,993 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0004_01_000001
2015-02-12 14:43:24,993 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0004 CONTAINERID=container_1423780884992_0004_01_000001
2015-02-12 14:43:24,993 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0004_01_000001]
2015-02-12 14:43:24,994 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:24,994 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:24,994 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:24,994 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000005
2015-02-12 14:43:24,995 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:43:24,995 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0004
2015-02-12 14:43:24,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:24,995 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:24,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:24,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:24,997 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:24,995 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0004, with delay of 10800 seconds
2015-02-12 14:43:25,385 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:25,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:25,385 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000006
2015-02-12 14:43:25,385 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:43:25,386 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,386 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0004
2015-02-12 14:43:25,386 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:25,386 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,386 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,386 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0004, with delay of 10800 seconds
2015-02-12 14:43:25,446 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 14:43:25,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 14:43:25,447 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0005_01_000002
2015-02-12 14:43:25,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 14:43:25,447 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:25,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 14:43:25,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 14:43:25,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 14:43:25,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 14:43:25,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 14:43:25,448 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0005_01_000003
2015-02-12 14:43:25,450 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:25,450 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0005_01_000004
2015-02-12 14:43:25,450 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 14:43:25,450 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 14:43:25,450 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 14:43:25,451 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 14:43:25,450 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:25,452 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:25,452 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0005_01_000006
2015-02-12 14:43:25,453 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:25,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:25,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:25,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:25,538 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:25,539 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0004
2015-02-12 14:43:25,540 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:25,540 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0004, with delay of 10800 seconds
2015-02-12 14:43:25,540 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,610 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:25,611 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:25,611 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:25,612 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:25,613 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:25,615 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000005 by user soberoi
2015-02-12 14:43:25,615 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0005
2015-02-12 14:43:25,616 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000005
2015-02-12 14:43:25,616 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from NEW to INITING
2015-02-12 14:43:25,616 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000005 to application application_1423780884992_0005
2015-02-12 14:43:25,616 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from INITING to RUNNING
2015-02-12 14:43:25,616 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:43:25,617 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,617 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,617 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:25,617 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0005
2015-02-12 14:43:25,617 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:25,617 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:25,618 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0005_01_000005
2015-02-12 14:43:25,618 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000003 by user soberoi
2015-02-12 14:43:25,618 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000006 by user soberoi
2015-02-12 14:43:25,618 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000006
2015-02-12 14:43:25,618 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0005
2015-02-12 14:43:25,619 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000006 to application application_1423780884992_0005
2015-02-12 14:43:25,619 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000003
2015-02-12 14:43:25,619 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:43:25,619 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,619 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from NEW to INITING
2015-02-12 14:43:25,619 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,619 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000003 to application application_1423780884992_0005
2015-02-12 14:43:25,619 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:25,619 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from INITING to RUNNING
2015-02-12 14:43:25,620 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0005
2015-02-12 14:43:25,620 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:43:25,620 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,620 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,620 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:25,620 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:25,620 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0005
2015-02-12 14:43:25,620 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:25,621 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:25,621 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0005_01_000003
2015-02-12 14:43:25,623 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000004 by user soberoi
2015-02-12 14:43:25,623 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000004
2015-02-12 14:43:25,623 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000002 by user soberoi
2015-02-12 14:43:25,625 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0005
2015-02-12 14:43:25,625 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000002
2015-02-12 14:43:25,625 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000004 to application application_1423780884992_0005
2015-02-12 14:43:25,626 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:43:25,626 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,626 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,626 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:25,626 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0005
2015-02-12 14:43:25,627 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0005_01_000004
2015-02-12 14:43:25,630 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from NEW to INITING
2015-02-12 14:43:25,630 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000002 to application application_1423780884992_0005
2015-02-12 14:43:25,631 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from INITING to RUNNING
2015-02-12 14:43:25,632 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:43:25,632 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,632 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0005
2015-02-12 14:43:25,632 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:25,632 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0005
2015-02-12 14:43:25,632 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:25,633 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:25,633 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0005_01_000002
2015-02-12 14:43:25,668 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0005_01_000003.tokens. Credentials list:
2015-02-12 14:43:25,670 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0005_01_000005.tokens. Credentials list:
2015-02-12 14:43:25,677 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0005_01_000004.tokens. Credentials list:
2015-02-12 14:43:25,680 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0005_01_000002.tokens. Credentials list:
2015-02-12 14:43:25,695 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:25,695 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:25,696 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:25,696 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0004
2015-02-12 14:43:25,697 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,697 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:25,698 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0004, with delay of 10800 seconds
2015-02-12 14:43:25,698 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,703 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0004
2015-02-12 14:43:25,709 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:25,710 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:25,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 14:43:25,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 14:43:25,813 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 14:43:25,813 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 14:43:25,813 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 14:43:25,837 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054
2015-02-12 14:43:25,838 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049
2015-02-12 14:43:25,840 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052
2015-02-12 14:43:25,841 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050
2015-02-12 14:43:25,841 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048
2015-02-12 14:43:25,924 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:25,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:25,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:25,995 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:25,995 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:26,041 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051
2015-02-12 14:43:26,043 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055
2015-02-12 14:43:26,044 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053
2015-02-12 14:43:26,080 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000006/default_container_executor.sh]
2015-02-12 14:43:26,172 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049
2015-02-12 14:43:26,173 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053
2015-02-12 14:43:26,173 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048
2015-02-12 14:43:26,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0005_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000003.tokens
2015-02-12 14:43:26,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:26,191 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0005_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000002.tokens
2015-02-12 14:43:26,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:26,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0005_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000005.tokens
2015-02-12 14:43:26,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:26,222 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055
2015-02-12 14:43:26,223 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051
2015-02-12 14:43:26,224 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050
2015-02-12 14:43:26,224 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054
2015-02-12 14:43:26,225 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053
2015-02-12 14:43:26,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:26,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:26,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:26,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:26,375 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052
2015-02-12 14:43:26,376 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741875_1051
2015-02-12 14:43:26,377 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741874_1050
2015-02-12 14:43:26,386 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:26,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:26,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:26,435 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:26,437 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:26,469 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:26,470 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:43:26,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:26,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:26,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:26,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:26,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:26,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:26,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:26,554 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:26,555 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:26,561 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:26,562 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:26,602 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:26,602 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:26,603 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:26,629 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:26,629 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:26,630 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:26,630 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:26,672 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:26,672 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:26,672 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:26,672 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:26,691 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741879_1055
2015-02-12 14:43:26,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741878_1054
2015-02-12 14:43:26,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741877_1053
2015-02-12 14:43:26,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741872_1048
2015-02-12 14:43:26,696 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:26,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000002/default_container_executor.sh]
2015-02-12 14:43:26,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000003/default_container_executor.sh]
2015-02-12 14:43:26,888 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000004/default_container_executor.sh]
2015-02-12 14:43:26,888 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000005/default_container_executor.sh]
2015-02-12 14:43:26,897 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052
2015-02-12 14:43:26,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741873_1049
2015-02-12 14:43:27,640 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:27,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0005_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000004.tokens
2015-02-12 14:43:27,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:31,048 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056
2015-02-12 14:43:31,049 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057
2015-02-12 14:43:31,231 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741876_1052
2015-02-12 14:43:31,382 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057
2015-02-12 14:43:31,383 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056
2015-02-12 14:43:31,902 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741881_1057
2015-02-12 14:43:31,903 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741880_1056
2015-02-12 14:43:34,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:35,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:35,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:35,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:35,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:35,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:35,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:35,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:35,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:35,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:43:35,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:43:35,975 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:35,978 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000006
2015-02-12 14:43:35,978 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000006
2015-02-12 14:43:35,978 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:43:35,978 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000006
2015-02-12 14:43:35,995 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0005_01_000006 is : 143
2015-02-12 14:43:35,997 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:43:35,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058 src: /127.0.0.1:51155 dest: /127.0.0.1:50539
2015-02-12 14:43:36,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058 src: /127.0.0.1:51156 dest: /127.0.0.1:50543
2015-02-12 14:43:36,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058 src: /127.0.0.1:51157 dest: /127.0.0.1:50549
2015-02-12 14:43:36,009 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:36,010 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000006
2015-02-12 14:43:36,010 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000006
2015-02-12 14:43:36,011 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000006
2015-02-12 14:43:36,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000006
2015-02-12 14:43:36,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000006
2015-02-12 14:43:36,012 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist for DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:36,011 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:36,012 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000006 from application application_1423780884992_0005
2015-02-12 14:43:36,013 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:36,014 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:36,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:43:36,241 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:36,243 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000003
2015-02-12 14:43:36,243 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000003
2015-02-12 14:43:36,243 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:43:36,243 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000003
2015-02-12 14:43:36,266 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0005_01_000003 is : 143
2015-02-12 14:43:36,273 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:36,274 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000003
2015-02-12 14:43:36,274 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000003
2015-02-12 14:43:36,274 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000003
2015-02-12 14:43:36,274 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000003
2015-02-12 14:43:36,275 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000003
2015-02-12 14:43:36,275 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:36,276 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000003 from application application_1423780884992_0005
2015-02-12 14:43:36,276 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:36,276 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:36,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:43:36,361 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:36,364 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000002
2015-02-12 14:43:36,364 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000002
2015-02-12 14:43:36,364 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:43:36,364 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000002
2015-02-12 14:43:36,392 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0005_01_000002 is : 143
2015-02-12 14:43:36,399 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:36,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000002
2015-02-12 14:43:36,403 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000002
2015-02-12 14:43:36,407 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000002
2015-02-12 14:43:36,408 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000002
2015-02-12 14:43:36,409 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000002
2015-02-12 14:43:36,409 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:36,409 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000002 from application application_1423780884992_0005
2015-02-12 14:43:36,410 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:36,410 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:36,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:43:36,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:43:36,482 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:36,485 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000004
2015-02-12 14:43:36,485 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000004
2015-02-12 14:43:36,485 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:43:36,486 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000004
2015-02-12 14:43:36,509 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0005_01_000004 is : 143
2015-02-12 14:43:36,514 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:36,515 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000004
2015-02-12 14:43:36,516 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:36,516 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000004
2015-02-12 14:43:36,516 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000004
2015-02-12 14:43:36,517 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000004
2015-02-12 14:43:36,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000004
2015-02-12 14:43:36,516 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000004 from application application_1423780884992_0005
2015-02-12 14:43:36,518 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:36,518 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:36,563 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:36,565 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000005
2015-02-12 14:43:36,565 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000005
2015-02-12 14:43:36,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:43:36,567 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000005
2015-02-12 14:43:36,567 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:36,567 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:43:36,567 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000004
2015-02-12 14:43:36,567 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:43:36,567 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000004 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:43:36,587 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0005_01_000005 is : 143
2015-02-12 14:43:36,603 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:36,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000005
2015-02-12 14:43:36,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000005
2015-02-12 14:43:36,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000005
2015-02-12 14:43:36,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000005
2015-02-12 14:43:36,606 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000005
2015-02-12 14:43:36,607 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:36,608 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000005 from application application_1423780884992_0005
2015-02-12 14:43:36,608 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:36,609 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:36,985 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:36,985 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:43:36,985 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000006
2015-02-12 14:43:36,985 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:43:36,985 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000006 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:43:37,247 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:37,247 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:43:37,247 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000003
2015-02-12 14:43:37,247 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:37,247 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000003 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:37,369 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:37,369 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:43:37,369 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000002
2015-02-12 14:43:37,370 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:37,370 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000002 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:37,568 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:37,569 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:37,569 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:43:37,569 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000005
2015-02-12 14:43:37,569 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:37,569 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000005 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:37,570 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:37,570 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000007
2015-02-12 14:43:37,571 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:37,987 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:38,248 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:38,373 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:38,538 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:38,548 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:38,550 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0005_01_000007 by user soberoi
2015-02-12 14:43:38,550 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000007
2015-02-12 14:43:38,550 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0005_01_000007 to application application_1423780884992_0005
2015-02-12 14:43:38,551 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:43:38,551 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0005
2015-02-12 14:43:38,551 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0005
2015-02-12 14:43:38,551 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:38,551 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0005
2015-02-12 14:43:38,552 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:38,572 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0005_01_000004]
2015-02-12 14:43:38,572 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:38,573 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:38,573 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:38,582 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:38,582 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:38,688 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000007/default_container_executor.sh]
2015-02-12 14:43:38,988 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0005_01_000006]
2015-02-12 14:43:38,988 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:39,250 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0005_01_000003]
2015-02-12 14:43:39,251 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:39,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0005_01_000002]
2015-02-12 14:43:39,376 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:39,521 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 14:43:39,521 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:43:39,543 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:43:39,575 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0005_01_000005]
2015-02-12 14:43:39,576 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:41,185 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:41,189 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:41,191 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:41,194 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:43:41,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,513 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:43:41,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059 src: /127.0.0.1:51170 dest: /127.0.0.1:50546
2015-02-12 14:43:41,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059 src: /127.0.0.1:51171 dest: /127.0.0.1:50543
2015-02-12 14:43:41,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059 src: /127.0.0.1:51172 dest: /127.0.0.1:50549
2015-02-12 14:43:41,653 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51172, dest: /127.0.0.1:50549, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0005_r_000000_0_797400141_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059, duration: 31958000
2015-02-12 14:43:41,654 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:41,654 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,654 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51171, dest: /127.0.0.1:50543, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0005_r_000000_0_797400141_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059, duration: 32722000
2015-02-12 14:43:41,654 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,655 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51170, dest: /127.0.0.1:50546, bytes: 235, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0005_r_000000_0_797400141_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059, duration: 33742000
2015-02-12 14:43:41,656 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,656 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,657 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,661 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0005_r_000000_0_797400141_1
2015-02-12 14:43:41,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:43:41,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:43:41,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/task_1423780884992_0005_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:43:41,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0005_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/task_1423780884992_0005_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:43:41,710 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:41,712 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000007
2015-02-12 14:43:41,712 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000007
2015-02-12 14:43:41,713 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:43:41,713 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000007
2015-02-12 14:43:41,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,728 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:43:41,749 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0005_01_000007 is : 143
2015-02-12 14:43:41,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:41,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:41,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/task_1423780884992_0005_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:43:41,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:41,758 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:43:41,759 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000007
2015-02-12 14:43:41,759 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000007
2015-02-12 14:43:41,759 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:43:41,760 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000007
2015-02-12 14:43:41,760 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000007
2015-02-12 14:43:41,760 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000007
2015-02-12 14:43:41,760 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000007 from application application_1423780884992_0005
2015-02-12 14:43:41,765 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:41,765 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:41,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary/1/task_1423780884992_0005_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:43:41,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,783 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,788 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,811 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51157, dest: /127.0.0.1:50549, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058, duration: 5805539000
2015-02-12 14:43:41,812 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:41,815 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16374
2015-02-12 14:43:41,815 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51156, dest: /127.0.0.1:50543, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058, duration: 5807981000
2015-02-12 14:43:41,815 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,816 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16374
2015-02-12 14:43:41,817 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51155, dest: /127.0.0.1:50539, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058, duration: 5810855000
2015-02-12 14:43:41,817 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16374
2015-02-12 14:43:41,819 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,825 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:43:41,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060 src: /127.0.0.1:51174 dest: /127.0.0.1:50546
2015-02-12 14:43:41,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060 src: /127.0.0.1:51175 dest: /127.0.0.1:50549
2015-02-12 14:43:41,831 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060 src: /127.0.0.1:51176 dest: /127.0.0.1:50543
2015-02-12 14:43:41,835 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51176, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060, duration: 1502000
2015-02-12 14:43:41,835 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:41,835 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,836 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51175, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060, duration: 2123000
2015-02-12 14:43:41,836 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,836 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,837 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51174, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060, duration: 3288000
2015-02-12 14:43:41,837 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,838 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,840 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:41,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:43:41,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:41,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:43:41,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:41,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:43:41,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,872 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:43:41,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061 src: /127.0.0.1:51178 dest: /127.0.0.1:50539
2015-02-12 14:43:41,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061 src: /127.0.0.1:51179 dest: /127.0.0.1:50546
2015-02-12 14:43:41,881 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061 src: /127.0.0.1:51180 dest: /127.0.0.1:50549
2015-02-12 14:43:41,884 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51180, dest: /127.0.0.1:50549, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061, duration: 1940000
2015-02-12 14:43:41,885 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:41,885 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:43:41,885 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51179, dest: /127.0.0.1:50546, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061, duration: 2830000
2015-02-12 14:43:41,885 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,886 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:43:41,886 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51178, dest: /127.0.0.1:50539, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061, duration: 3688000
2015-02-12 14:43:41,886 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:43:41,889 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:41,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:43:41,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:41,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:43:41,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:43:41,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005/job_1423780884992_0005_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:43:41,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:41,907 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:43:41,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062 src: /127.0.0.1:51182 dest: /127.0.0.1:50549
2015-02-12 14:43:41,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062 src: /127.0.0.1:51183 dest: /127.0.0.1:50539
2015-02-12 14:43:41,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062 src: /127.0.0.1:51184 dest: /127.0.0.1:50546
2015-02-12 14:43:41,916 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51184, dest: /127.0.0.1:50546, bytes: 114649, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062, duration: 1916000
2015-02-12 14:43:41,916 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:41,917 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,917 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51183, dest: /127.0.0.1:50539, bytes: 114649, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062, duration: 2438000
2015-02-12 14:43:41,917 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,918 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51182, dest: /127.0.0.1:50549, bytes: 114649, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1845008737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062, duration: 3834000
2015-02-12 14:43:41,919 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:41,918 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,920 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:41,923 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1845008737_1
2015-02-12 14:43:41,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:41,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:41,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:41,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:43:41,946 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0005_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:43:41,946 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:43:41,946 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0005 with final state: FINISHING
2015-02-12 14:43:41,947 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from RUNNING to FINAL_SAVING
2015-02-12 14:43:41,947 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0005
2015-02-12 14:43:41,947 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:43:41,947 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from FINAL_SAVING to FINISHING
2015-02-12 14:43:42,719 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:42,719 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:43:42,719 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000007
2015-02-12 14:43:42,719 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:42,720 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000007 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:42,953 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0005 unregistered successfully.
2015-02-12 14:43:42,957 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741876_1052 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:43:42,957 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741877_1053 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:43:42,957 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741878_1054 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:43:42,957 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741879_1055 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:43:42,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741881_1057 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:43:42,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741882_1058 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:43:42,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741880_1056 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:43:42,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0005 dst=null perm=null proto=rpc
2015-02-12 14:43:43,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,036 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary
2015-02-12 14:43:43,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:43:43,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,051 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:43,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:43,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,068 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:43,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:43,071 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter
2015-02-12 14:43:43,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:43,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:43,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:43,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter dst=null perm=null proto=rpc
2015-02-12 14:43:43,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:43,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:43,080 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup
2015-02-12 14:43:43,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:43:43,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:43,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:43:43,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,097 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:43:43,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063 src: /127.0.0.1:51188 dest: /127.0.0.1:50549
2015-02-12 14:43:43,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063 src: /127.0.0.1:51189 dest: /127.0.0.1:50539
2015-02-12 14:43:43,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063 src: /127.0.0.1:51190 dest: /127.0.0.1:50543
2015-02-12 14:43:43,104 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51190, dest: /127.0.0.1:50543, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063, duration: 1251000
2015-02-12 14:43:43,105 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:43,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,105 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51189, dest: /127.0.0.1:50539, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063, duration: 2021000
2015-02-12 14:43:43,106 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,108 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51188, dest: /127.0.0.1:50549, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063, duration: 4562000
2015-02-12 14:43:43,109 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,109 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,111 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,112 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:43,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,122 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:43:43,125 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064 src: /127.0.0.1:51191 dest: /127.0.0.1:50549
2015-02-12 14:43:43,127 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064 src: /127.0.0.1:51192 dest: /127.0.0.1:50543
2015-02-12 14:43:43,131 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064 src: /127.0.0.1:51193 dest: /127.0.0.1:50546
2015-02-12 14:43:43,134 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51193, dest: /127.0.0.1:50546, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064, duration: 1249000
2015-02-12 14:43:43,134 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:43,135 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51192, dest: /127.0.0.1:50543, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064, duration: 1869000
2015-02-12 14:43:43,136 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,136 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,137 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51191, dest: /127.0.0.1:50549, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064, duration: 3537000
2015-02-12 14:43:43,137 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,138 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,140 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741888_1064 size 20
2015-02-12 14:43:43,140 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:43,164 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:43:43,165 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:43:43,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:43:43,203 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] starting
2015-02-12 14:43:43,203 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] source: Hfs["TextDelimited[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt"]
2015-02-12 14:43:43,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] source: Hfs["TextDelimited[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt"]
2015-02-12 14:43:43,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] source: Hfs["TextDelimited[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt"]
2015-02-12 14:43:43,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2"]
2015-02-12 14:43:43,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] parallel execution is enabled: true
2015-02-12 14:43:43,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] starting jobs: 2
2015-02-12 14:43:43,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] allocating threads: 2
2015-02-12 14:43:43,207 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] starting step: (2/2)
2015-02-12 14:43:43,221 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:43:43,235 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:43:43,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:43:43,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:43:43,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:43:43,243 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 6
2015-02-12 14:43:43,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006 dst=null perm=null proto=rpc
2015-02-12 14:43:43,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:43:43,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:43:43,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,252 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:43:43,255 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 src: /127.0.0.1:51195 dest: /127.0.0.1:50543
2015-02-12 14:43:43,256 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 src: /127.0.0.1:51196 dest: /127.0.0.1:50549
2015-02-12 14:43:43,258 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 src: /127.0.0.1:51197 dest: /127.0.0.1:50546
2015-02-12 14:43:43,264 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51197, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065, duration: 2712000
2015-02-12 14:43:43,265 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:43,265 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,266 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51196, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065, duration: 3342000
2015-02-12 14:43:43,266 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,267 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,267 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51195, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065, duration: 5592000
2015-02-12 14:43:43,268 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,269 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,276 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:43,277 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar
2015-02-12 14:43:43,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:43:43,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:43:43,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:43:43,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:43:43,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:43:43,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,293 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:43,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,296 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:43,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,299 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:43,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,303 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:43:43,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:43:43,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,312 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split
2015-02-12 14:43:43,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:43,314 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:43:43,316 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066 src: /127.0.0.1:51198 dest: /127.0.0.1:50543
2015-02-12 14:43:43,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066 src: /127.0.0.1:51199 dest: /127.0.0.1:50539
2015-02-12 14:43:43,318 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066 src: /127.0.0.1:51200 dest: /127.0.0.1:50546
2015-02-12 14:43:43,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066 src: /127.0.0.1:51201 dest: /127.0.0.1:50549
2015-02-12 14:43:43,325 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51201, dest: /127.0.0.1:50549, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, duration: 3432000
2015-02-12 14:43:43,326 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:43,327 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:43:43,327 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51200, dest: /127.0.0.1:50546, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, duration: 4824000
2015-02-12 14:43:43,328 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,329 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51199, dest: /127.0.0.1:50539, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, duration: 7384000
2015-02-12 14:43:43,330 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,330 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,332 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51198, dest: /127.0.0.1:50543, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, duration: 9905000
2015-02-12 14:43:43,333 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,337 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,338 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,340 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:43,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,349 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:43:43,351 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067 src: /127.0.0.1:51202 dest: /127.0.0.1:50543
2015-02-12 14:43:43,353 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067 src: /127.0.0.1:51203 dest: /127.0.0.1:50549
2015-02-12 14:43:43,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067 src: /127.0.0.1:51204 dest: /127.0.0.1:50539
2015-02-12 14:43:43,357 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51204, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067, duration: 1230000
2015-02-12 14:43:43,358 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:43,358 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,358 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51203, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067, duration: 1898000
2015-02-12 14:43:43,358 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,359 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51202, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067, duration: 2830000
2015-02-12 14:43:43,359 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,361 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,363 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:43,363 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:43:43,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:43:43,381 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:43:43,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068 src: /127.0.0.1:51205 dest: /127.0.0.1:50543
2015-02-12 14:43:43,388 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068 src: /127.0.0.1:51206 dest: /127.0.0.1:50539
2015-02-12 14:43:43,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068 src: /127.0.0.1:51207 dest: /127.0.0.1:50546
2015-02-12 14:43:43,395 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51207, dest: /127.0.0.1:50546, bytes: 97490, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068, duration: 2219000
2015-02-12 14:43:43,395 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:43,396 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:43:43,396 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51206, dest: /127.0.0.1:50539, bytes: 97490, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068, duration: 4330000
2015-02-12 14:43:43,397 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,397 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51205, dest: /127.0.0.1:50543, bytes: 97490, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068, duration: 5404000
2015-02-12 14:43:43,398 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:43,399 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:43,400 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:43:43,400 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0006
2015-02-12 14:43:43,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006 dst=null perm=null proto=rpc
2015-02-12 14:43:43,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:43,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:43,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:43,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:43,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:43,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:43,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:43,420 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 6 submitted by user soberoi
2015-02-12 14:43:43,420 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0006
2015-02-12 14:43:43,420 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0006
2015-02-12 14:43:43,420 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0006
2015-02-12 14:43:43,420 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from NEW to NEW_SAVING
2015-02-12 14:43:43,421 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:43:43,421 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0006 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:43:43,421 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from SUBMITTED to ACCEPTED
2015-02-12 14:43:43,421 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0006_000001
2015-02-12 14:43:43,421 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from NEW to SUBMITTED
2015-02-12 14:43:43,422 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0006_000001 to scheduler from user: soberoi
2015-02-12 14:43:43,422 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:43:43,422 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0006
2015-02-12 14:43:43,425 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0006/
2015-02-12 14:43:43,425 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] submitted hadoop job: job_1423780884992_0006
2015-02-12 14:43:43,425 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0006/
2015-02-12 14:43:43,721 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:43,723 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:43,723 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000001
2015-02-12 14:43:43,723 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:43:43,724 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0006_01_000001
2015-02-12 14:43:43,724 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:43,724 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0006_000001
2015-02-12 14:43:43,724 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0006 AttemptId: appattempt_1423780884992_0006_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0006_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:43:43,725 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:43:43,725 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:43:43,725 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0006_000001
2015-02-12 14:43:43,726 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0006_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0006_000001
2015-02-12 14:43:43,727 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0006_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:43:43,727 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0006_000001
2015-02-12 14:43:43,727 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0006_000001
2015-02-12 14:43:43,729 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:43,731 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000001 by user soberoi
2015-02-12 14:43:43,732 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0006
2015-02-12 14:43:43,732 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000001
2015-02-12 14:43:43,732 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from NEW to INITING
2015-02-12 14:43:43,732 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000001 to application application_1423780884992_0006
2015-02-12 14:43:43,732 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from INITING to RUNNING
2015-02-12 14:43:43,732 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0006_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0006_000001
2015-02-12 14:43:43,733 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:43:43,733 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:43:43,733 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:43:43,733 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:43,734 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:43:43,734 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:43:43,734 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:43,734 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0006_01_000001
2015-02-12 14:43:43,743 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0006_01_000001.tokens. Credentials list:
2015-02-12 14:43:43,854 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:43,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0006_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000001.tokens
2015-02-12 14:43:43,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:43:44,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:44,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:44,081 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:44,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:44,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:44,149 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:44,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:44,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:44,217 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0006/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:44,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:44,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:44,283 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0006/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:44,283 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:44,329 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:44,329 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:44,455 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000001/default_container_executor.sh]
2015-02-12 14:43:44,726 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:44,726 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:45,599 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073741889_1065 to datanode(s) 127.0.0.1:50539
2015-02-12 14:43:45,599 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741879_1055]
2015-02-12 14:43:45,599 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741879_1055, blk_1073741880_1056, blk_1073741881_1057, blk_1073741882_1058]
2015-02-12 14:43:45,730 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:46,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:43:46,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:43:46,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:43:46,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:43:46,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006 dst=null perm=null proto=rpc
2015-02-12 14:43:46,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:43:46,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:43:46,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:46,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:43:46,734 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:46,831 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 to 127.0.0.1:50539
2015-02-12 14:43:46,831 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 14:43:46,832 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 14:43:46,832 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741878 for deletion
2015-02-12 14:43:46,832 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741879 for deletion
2015-02-12 14:43:46,832 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 14:43:46,832 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741878
2015-02-12 14:43:46,833 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 14:43:46,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 src: /127.0.0.1:51227 dest: /127.0.0.1:50539
2015-02-12 14:43:46,833 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:43:46,833 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741879
2015-02-12 14:43:46,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065 src: /127.0.0.1:51227 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:43:46,835 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741889_1065 size 254067
2015-02-12 14:43:46,916 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059
2015-02-12 14:43:46,917 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061
2015-02-12 14:43:46,917 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060
2015-02-12 14:43:46,918 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741882_1058
2015-02-12 14:43:47,098 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 14:43:47,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 14:43:47,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741878 for deletion
2015-02-12 14:43:47,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741879 for deletion
2015-02-12 14:43:47,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 14:43:47,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741878
2015-02-12 14:43:47,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 14:43:47,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 14:43:47,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741879
2015-02-12 14:43:47,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741881 for deletion
2015-02-12 14:43:47,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 14:43:47,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741882 for deletion
2015-02-12 14:43:47,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741881
2015-02-12 14:43:47,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741882
2015-02-12 14:43:47,652 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:47,654 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0006_000001
2015-02-12 14:43:47,654 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0006 APPATTEMPTID=appattempt_1423780884992_0006_000001
2015-02-12 14:43:47,655 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:43:47,655 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from ACCEPTED to RUNNING
2015-02-12 14:43:47,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:47,737 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:47,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:43:47,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:48,008 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0005_01_000001 succeeded
2015-02-12 14:43:48,008 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:43:48,008 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0005_01_000001
2015-02-12 14:43:48,031 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000001
2015-02-12 14:43:48,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000001
2015-02-12 14:43:48,033 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000001
2015-02-12 14:43:48,034 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0005/container_1423780884992_0005_01_000001
2015-02-12 14:43:48,035 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000001
2015-02-12 14:43:48,035 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:43:48,035 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0005_01_000001 from application application_1423780884992_0005
2015-02-12 14:43:48,036 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:48,036 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0005
2015-02-12 14:43:48,092 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:43:48,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069 src: /127.0.0.1:51233 dest: /127.0.0.1:50546
2015-02-12 14:43:48,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069 src: /127.0.0.1:51234 dest: /127.0.0.1:50543
2015-02-12 14:43:48,150 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069 src: /127.0.0.1:51235 dest: /127.0.0.1:50539
2015-02-12 14:43:48,192 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51235, dest: /127.0.0.1:50539, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069, duration: 40939000
2015-02-12 14:43:48,192 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:48,193 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:48,193 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51234, dest: /127.0.0.1:50543, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069, duration: 41788000
2015-02-12 14:43:48,193 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:48,194 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51233, dest: /127.0.0.1:50546, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069, duration: 43079000
2015-02-12 14:43:48,195 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:48,196 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:48,198 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:43:48,202 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:43:48,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:43:48,246 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:43:48,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070 src: /127.0.0.1:51236 dest: /127.0.0.1:50546
2015-02-12 14:43:48,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070 src: /127.0.0.1:51237 dest: /127.0.0.1:50543
2015-02-12 14:43:48,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070 src: /127.0.0.1:51238 dest: /127.0.0.1:50549
2015-02-12 14:43:48,255 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51238, dest: /127.0.0.1:50549, bytes: 365, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070, duration: 1514000
2015-02-12 14:43:48,255 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:43:48,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:43:48,256 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51237, dest: /127.0.0.1:50543, bytes: 365, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070, duration: 2174000
2015-02-12 14:43:48,256 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:48,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:43:48,257 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51236, dest: /127.0.0.1:50546, bytes: 365, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070, duration: 3377000
2015-02-12 14:43:48,257 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:43:48,258 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:43:48,263 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006.summary is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:43:48,602 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741879_1055, blk_1073741880_1056, blk_1073741881_1057, blk_1073741882_1058]
2015-02-12 14:43:48,603 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741876_1052, blk_1073741877_1053, blk_1073741880_1056, blk_1073741881_1057, blk_1073741882_1058]
2015-02-12 14:43:48,739 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:48,739 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:48,739 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000002
2015-02-12 14:43:48,740 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:43:49,013 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:43:49,013 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0005_000001
2015-02-12 14:43:49,014 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0005_000001
2015-02-12 14:43:49,013 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0005_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:43:49,014 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000001
2015-02-12 14:43:49,014 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:43:49,015 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0005_000001 released container container_1423780884992_0005_01_000001 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:43:49,014 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0005_000001 State change from FINISHING to FINISHED
2015-02-12 14:43:49,015 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0005 State change from FINISHING to FINISHED
2015-02-12 14:43:49,016 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:49,016 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000003
2015-02-12 14:43:49,016 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:49,016 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0005
2015-02-12 14:43:49,016 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0005_000001 is done. finalState=FINISHED
2015-02-12 14:43:49,017 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0005 requests cleared
2015-02-12 14:43:49,017 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0005,name=[DEE6C0C8C50E4B18B707131922FC0A04/C2C7A9613B53416E86B29B6052860FC4] lower*upper/(1/1) .../cogroupouter-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0005/jobhistory/job/job_1423780884992_0005,appMasterHost=10.1.1.67,startTime=1423780999364,finishTime=1423781021946,finalStatus=SUCCEEDED
2015-02-12 14:43:49,016 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0005_000001
2015-02-12 14:43:49,019 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0005_000001 (auth:SIMPLE)
2015-02-12 14:43:49,021 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0005_01_000001
2015-02-12 14:43:49,021 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0005 CONTAINERID=container_1423780884992_0005_01_000001
2015-02-12 14:43:49,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0005_01_000001]
2015-02-12 14:43:49,022 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:49,022 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:49,022 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:49,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,022 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000004
2015-02-12 14:43:49,025 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:43:49,023 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0005
2015-02-12 14:43:49,025 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:49,025 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0005, with delay of 10800 seconds
2015-02-12 14:43:49,275 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:49,275 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:49,275 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000005
2015-02-12 14:43:49,275 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:49,276 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,276 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0005
2015-02-12 14:43:49,276 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,277 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,277 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,276 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:49,277 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0005, with delay of 10800 seconds
2015-02-12 14:43:49,400 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:49,401 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:43:49,401 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000006
2015-02-12 14:43:49,401 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:43:49,401 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,402 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0005
2015-02-12 14:43:49,402 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,402 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:49,402 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0005, with delay of 10800 seconds
2015-02-12 14:43:49,403 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,402 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 14:43:49,456 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 14:43:49,456 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 14:43:49,457 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 14:43:49,457 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 14:43:49,457 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 14:43:49,457 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741881 for deletion
2015-02-12 14:43:49,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741882 for deletion
2015-02-12 14:43:49,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741881
2015-02-12 14:43:49,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741882
2015-02-12 14:43:49,468 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876 for deletion
2015-02-12 14:43:49,468 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 14:43:49,468 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741878 for deletion
2015-02-12 14:43:49,468 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741879 for deletion
2015-02-12 14:43:49,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741876
2015-02-12 14:43:49,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 14:43:49,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741878
2015-02-12 14:43:49,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741879
2015-02-12 14:43:49,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 14:43:49,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741881 for deletion
2015-02-12 14:43:49,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741882 for deletion
2015-02-12 14:43:49,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 14:43:49,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741881_1057 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741881
2015-02-12 14:43:49,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741882
2015-02-12 14:43:49,707 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0006_01_000002
2015-02-12 14:43:49,707 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:49,708 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0006_01_000003
2015-02-12 14:43:49,708 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:49,709 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:49,709 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0006_01_000005
2015-02-12 14:43:49,709 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:49,710 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0006_01_000006
2015-02-12 14:43:49,710 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:43:49,743 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:43:49,743 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:49,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,744 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0005
2015-02-12 14:43:49,745 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:43:49,745 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0005, with delay of 10800 seconds
2015-02-12 14:43:49,746 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,747 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,746 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0005
2015-02-12 14:43:49,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:49,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:49,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:43:49,862 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:49,862 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:49,862 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:49,863 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:49,863 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:43:49,867 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000002 by user soberoi
2015-02-12 14:43:49,868 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000002
2015-02-12 14:43:49,868 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000005 by user soberoi
2015-02-12 14:43:49,868 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0006
2015-02-12 14:43:49,868 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000006 by user soberoi
2015-02-12 14:43:49,869 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0006
2015-02-12 14:43:49,869 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000006
2015-02-12 14:43:49,867 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000004 by user soberoi
2015-02-12 14:43:49,869 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000002 to application application_1423780884992_0006
2015-02-12 14:43:49,870 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:43:49,870 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000003 by user soberoi
2015-02-12 14:43:49,870 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000003
2015-02-12 14:43:49,871 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from NEW to INITING
2015-02-12 14:43:49,871 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000005 to application application_1423780884992_0006
2015-02-12 14:43:49,871 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from INITING to RUNNING
2015-02-12 14:43:49,872 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:43:49,872 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,872 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,872 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:49,872 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0006
2015-02-12 14:43:49,872 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:49,872 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:49,872 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0006_01_000005
2015-02-12 14:43:49,873 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000003 to application application_1423780884992_0006
2015-02-12 14:43:49,868 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000005
2015-02-12 14:43:49,872 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from NEW to INITING
2015-02-12 14:43:49,875 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000006 to application application_1423780884992_0006
2015-02-12 14:43:49,876 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from INITING to RUNNING
2015-02-12 14:43:49,876 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:43:49,876 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,876 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,876 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:49,876 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0006
2015-02-12 14:43:49,876 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:49,876 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:49,870 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,877 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0006_01_000006
2015-02-12 14:43:49,869 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0006
2015-02-12 14:43:49,877 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000004
2015-02-12 14:43:49,877 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from NEW to INITING
2015-02-12 14:43:49,877 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000004 to application application_1423780884992_0006
2015-02-12 14:43:49,877 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,878 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:49,878 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0006
2015-02-12 14:43:49,878 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from INITING to RUNNING
2015-02-12 14:43:49,878 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:43:49,878 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:49,879 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:43:49,879 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,879 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,879 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:49,879 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0006
2015-02-12 14:43:49,879 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:43:49,879 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:43:49,879 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,879 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0006
2015-02-12 14:43:49,880 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:43:49,880 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0006
2015-02-12 14:43:49,880 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0006_01_000004
2015-02-12 14:43:49,881 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0006_01_000003
2015-02-12 14:43:49,899 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0006_01_000006.tokens. Credentials list:
2015-02-12 14:43:49,899 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0006_01_000005.tokens. Credentials list:
2015-02-12 14:43:49,908 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0006_01_000004.tokens. Credentials list:
2015-02-12 14:43:49,908 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0006_01_000003.tokens. Credentials list:
2015-02-12 14:43:49,984 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:49,984 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:50,025 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:50,026 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:50,140 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:50,142 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:50,198 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000002/default_container_executor.sh]
2015-02-12 14:43:50,278 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:50,285 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:50,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000006.tokens
2015-02-12 14:43:50,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:43:50,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0006_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000005.tokens
2015-02-12 14:43:50,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:43:50,404 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:50,464 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000003.tokens
2015-02-12 14:43:50,465 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:43:50,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:50,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:50,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:50,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:50,583 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:50,607 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:50,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:50,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:50,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:50,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:50,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar dst=null perm=null proto=rpc
2015-02-12 14:43:50,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:50,689 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:50,689 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:50,713 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:50,713 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:50,720 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:50,724 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:43:50,746 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:43:50,746 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:43:50,766 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:50,766 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:50,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:50,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml dst=null perm=null proto=rpc
2015-02-12 14:43:50,786 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:50,786 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:50,849 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:43:50,849 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:50,849 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:43:50,923 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:50,924 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:50,924 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:43:50,924 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:43:50,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000005/default_container_executor.sh]
2015-02-12 14:43:50,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000006/default_container_executor.sh]
2015-02-12 14:43:51,059 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060
2015-02-12 14:43:51,060 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066
2015-02-12 14:43:51,060 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059
2015-02-12 14:43:51,060 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067
2015-02-12 14:43:51,062 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065
2015-02-12 14:43:51,064 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064
2015-02-12 14:43:51,064 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063
2015-02-12 14:43:51,153 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000004/default_container_executor.sh]
2015-02-12 14:43:51,156 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000003/default_container_executor.sh]
2015-02-12 14:43:51,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741883_1059
2015-02-12 14:43:51,245 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066
2015-02-12 14:43:51,246 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061
2015-02-12 14:43:51,247 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741884_1060
2015-02-12 14:43:51,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062
2015-02-12 14:43:51,265 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068
2015-02-12 14:43:51,398 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062
2015-02-12 14:43:51,400 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068
2015-02-12 14:43:51,400 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067
2015-02-12 14:43:51,402 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063
2015-02-12 14:43:51,403 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066
2015-02-12 14:43:51,404 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741885_1061
2015-02-12 14:43:51,648 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065
2015-02-12 14:43:51,649 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064
2015-02-12 14:43:51,650 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741892_1068
2015-02-12 14:43:51,884 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:43:51,922 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741888_1064
2015-02-12 14:43:51,923 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741887_1063
2015-02-12 14:43:51,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065
2015-02-12 14:43:52,035 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0006_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000004.tokens
2015-02-12 14:43:52,035 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:43:52,125 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741886_1062
2015-02-12 14:43:52,126 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741890_1066
2015-02-12 14:43:52,126 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741891_1067
2015-02-12 14:43:56,271 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069
2015-02-12 14:43:56,271 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070
2015-02-12 14:43:56,611 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741889_1065
2015-02-12 14:43:56,612 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069
2015-02-12 14:43:56,654 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741893_1069
2015-02-12 14:43:56,654 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070
2015-02-12 14:43:57,132 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741894_1070
2015-02-12 14:43:59,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:59,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:59,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:59,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:59,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job.split dst=null perm=null proto=rpc
2015-02-12 14:43:59,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:00,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:00,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:00,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:00,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:00,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:00,533 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:00,535 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000002
2015-02-12 14:44:00,535 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000002
2015-02-12 14:44:00,535 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:44:00,535 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000002
2015-02-12 14:44:00,556 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0006_01_000002 is : 143
2015-02-12 14:44:00,565 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:00,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000002
2015-02-12 14:44:00,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000002
2015-02-12 14:44:00,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000002
2015-02-12 14:44:00,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000002
2015-02-12 14:44:00,568 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000002
2015-02-12 14:44:00,568 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:00,569 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000002 from application application_1423780884992_0006
2015-02-12 14:44:00,569 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:00,569 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:00,570 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:44:00,573 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071 src: /127.0.0.1:51275 dest: /127.0.0.1:50546
2015-02-12 14:44:00,579 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071 src: /127.0.0.1:51276 dest: /127.0.0.1:50543
2015-02-12 14:44:00,580 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071 src: /127.0.0.1:51277 dest: /127.0.0.1:50539
2015-02-12 14:44:00,593 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist for DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:00,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:44:00,779 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:00,781 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000006
2015-02-12 14:44:00,781 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000006
2015-02-12 14:44:00,781 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:44:00,781 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000006
2015-02-12 14:44:00,804 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0006_01_000006 is : 143
2015-02-12 14:44:00,816 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:00,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000006
2015-02-12 14:44:00,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000006
2015-02-12 14:44:00,818 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000006
2015-02-12 14:44:00,819 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000006
2015-02-12 14:44:00,819 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000006
2015-02-12 14:44:00,819 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:00,820 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000006 from application application_1423780884992_0006
2015-02-12 14:44:00,820 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:00,820 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:00,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:44:00,944 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:00,946 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000003
2015-02-12 14:44:00,946 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000003
2015-02-12 14:44:00,946 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:44:00,947 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000003
2015-02-12 14:44:00,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:44:00,974 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0006_01_000003 is : 143
2015-02-12 14:44:00,985 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:00,986 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000003
2015-02-12 14:44:00,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000003
2015-02-12 14:44:00,991 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000003
2015-02-12 14:44:00,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000003
2015-02-12 14:44:00,993 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000003
2015-02-12 14:44:00,997 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:00,998 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000003 from application application_1423780884992_0006
2015-02-12 14:44:00,998 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:00,998 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:01,006 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:01,010 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000005
2015-02-12 14:44:01,010 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000005
2015-02-12 14:44:01,010 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:44:01,010 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000005
2015-02-12 14:44:01,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:44:01,033 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0006_01_000005 is : 143
2015-02-12 14:44:01,048 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:01,049 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000005
2015-02-12 14:44:01,051 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:01,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000005
2015-02-12 14:44:01,053 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000004
2015-02-12 14:44:01,053 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000004
2015-02-12 14:44:01,054 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:01,054 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:44:01,054 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000003
2015-02-12 14:44:01,055 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:44:01,055 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000003 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:44:01,056 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:44:01,056 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000005
2015-02-12 14:44:01,061 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000005
2015-02-12 14:44:01,062 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000005
2015-02-12 14:44:01,062 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:01,063 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000005 from application application_1423780884992_0006
2015-02-12 14:44:01,063 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:01,063 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:01,063 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000004
2015-02-12 14:44:01,084 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0006_01_000004 is : 143
2015-02-12 14:44:01,100 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:01,100 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000004
2015-02-12 14:44:01,101 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000004
2015-02-12 14:44:01,102 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000004
2015-02-12 14:44:01,103 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000004
2015-02-12 14:44:01,103 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000004
2015-02-12 14:44:01,104 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:01,105 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000004 from application application_1423780884992_0006
2015-02-12 14:44:01,105 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:01,105 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:01,540 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:01,540 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:44:01,540 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000002
2015-02-12 14:44:01,540 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:44:01,540 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000002 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:44:01,784 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:01,784 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:44:01,784 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000006
2015-02-12 14:44:01,785 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:01,785 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000006 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:01,785 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:01,785 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000007
2015-02-12 14:44:01,785 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:02,017 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:02,017 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:44:02,017 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000005
2015-02-12 14:44:02,017 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:02,018 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000005 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:02,057 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:02,057 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:02,057 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:44:02,058 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000004
2015-02-12 14:44:02,058 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:02,058 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:02,541 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:02,789 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:02,790 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:02,801 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:02,804 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0006_01_000007 by user soberoi
2015-02-12 14:44:02,804 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000007
2015-02-12 14:44:02,804 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0006_01_000007 to application application_1423780884992_0006
2015-02-12 14:44:02,804 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:44:02,804 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0006
2015-02-12 14:44:02,805 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0006
2015-02-12 14:44:02,805 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:02,805 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0006
2015-02-12 14:44:02,806 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:02,839 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:02,839 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:02,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000007/default_container_executor.sh]
2015-02-12 14:44:03,019 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:03,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0006_01_000003]
2015-02-12 14:44:03,062 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:03,062 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:03,544 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0006_01_000002]
2015-02-12 14:44:03,544 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:03,793 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:03,793 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:03,796 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:44:04,025 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0006_01_000005]
2015-02-12 14:44:04,025 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:04,064 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0006_01_000004]
2015-02-12 14:44:04,064 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:04,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0006_01_000006]
2015-02-12 14:44:04,798 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:05,385 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:05,387 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:05,389 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:05,393 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:05,401 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:05,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:05,672 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:44:05,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072 src: /127.0.0.1:51291 dest: /127.0.0.1:50546
2015-02-12 14:44:05,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072 src: /127.0.0.1:51292 dest: /127.0.0.1:50543
2015-02-12 14:44:05,778 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072 src: /127.0.0.1:51293 dest: /127.0.0.1:50549
2015-02-12 14:44:05,821 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51293, dest: /127.0.0.1:50549, bytes: 42, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0006_r_000000_0_1935499422_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072, duration: 41030000
2015-02-12 14:44:05,821 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:05,822 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51292, dest: /127.0.0.1:50543, bytes: 42, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0006_r_000000_0_1935499422_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072, duration: 41720000
2015-02-12 14:44:05,822 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:05,823 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:44:05,824 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51291, dest: /127.0.0.1:50546, bytes: 42, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0006_r_000000_0_1935499422_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072, duration: 43551000
2015-02-12 14:44:05,824 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:05,830 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:05,831 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:05,834 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0006_r_000000_0_1935499422_1
2015-02-12 14:44:05,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:05,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:05,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/task_1423780884992_0006_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:44:05,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/_temporary/attempt_1423780884992_0006_r_000000_0 dst=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/task_1423780884992_0006_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:44:05,879 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:05,881 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000007
2015-02-12 14:44:05,882 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000007
2015-02-12 14:44:05,882 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:44:05,882 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000007
2015-02-12 14:44:05,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:05,892 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:05,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:44:05,903 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0006_01_000007 is : 143
2015-02-12 14:44:05,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:05,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:05,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/task_1423780884992_0006_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:44:05,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:05,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary/1/task_1423780884992_0006_r_000000/part-00000 dst=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:05,929 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:05,931 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000007
2015-02-12 14:44:05,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_temporary dst=null perm=null proto=rpc
2015-02-12 14:44:05,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000007
2015-02-12 14:44:05,933 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000007
2015-02-12 14:44:05,935 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000007
2015-02-12 14:44:05,936 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000007
2015-02-12 14:44:05,936 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:05,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:05,936 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000007 from application application_1423780884992_0006
2015-02-12 14:44:05,936 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:05,937 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:05,938 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/_SUCCESS is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:05,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:05,943 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:05,963 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51277, dest: /127.0.0.1:50539, bytes: 69144, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071, duration: 5379351000
2015-02-12 14:44:05,963 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:05,964 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16341
2015-02-12 14:44:05,965 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51276, dest: /127.0.0.1:50543, bytes: 69144, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071, duration: 5377662000
2015-02-12 14:44:05,965 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:05,967 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16341
2015-02-12 14:44:05,968 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51275, dest: /127.0.0.1:50546, bytes: 69144, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071, duration: 5382626000
2015-02-12 14:44:05,969 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:05,970 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16341
2015-02-12 14:44:05,971 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:05,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:05,976 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:44:05,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073 src: /127.0.0.1:51295 dest: /127.0.0.1:50543
2015-02-12 14:44:05,982 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073 src: /127.0.0.1:51296 dest: /127.0.0.1:50539
2015-02-12 14:44:05,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073 src: /127.0.0.1:51297 dest: /127.0.0.1:50546
2015-02-12 14:44:05,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51297, dest: /127.0.0.1:50546, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073, duration: 2671000
2015-02-12 14:44:05,988 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:05,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:05,989 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51296, dest: /127.0.0.1:50539, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073, duration: 3496000
2015-02-12 14:44:05,989 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:05,990 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:05,990 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51295, dest: /127.0.0.1:50543, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073, duration: 4716000
2015-02-12 14:44:05,991 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:05,992 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:05,993 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:05,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:06,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:06,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:06,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:06,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:06,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:06,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:06,028 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:44:06,030 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074 src: /127.0.0.1:51299 dest: /127.0.0.1:50546
2015-02-12 14:44:06,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074 src: /127.0.0.1:51300 dest: /127.0.0.1:50539
2015-02-12 14:44:06,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074 src: /127.0.0.1:51301 dest: /127.0.0.1:50543
2015-02-12 14:44:06,037 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51301, dest: /127.0.0.1:50543, bytes: 69144, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074, duration: 1887000
2015-02-12 14:44:06,037 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:06,038 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:06,038 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51300, dest: /127.0.0.1:50539, bytes: 69144, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074, duration: 2550000
2015-02-12 14:44:06,038 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:06,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:06,039 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51299, dest: /127.0.0.1:50546, bytes: 69144, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074, duration: 3938000
2015-02-12 14:44:06,039 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:06,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:06,042 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:06,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:06,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:06,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:06,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:06,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:06,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006/job_1423780884992_0006_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:06,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:06,060 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:44:06,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075 src: /127.0.0.1:51303 dest: /127.0.0.1:50539
2015-02-12 14:44:06,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075 src: /127.0.0.1:51304 dest: /127.0.0.1:50549
2015-02-12 14:44:06,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075 src: /127.0.0.1:51305 dest: /127.0.0.1:50546
2015-02-12 14:44:06,073 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51305, dest: /127.0.0.1:50546, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075, duration: 2049000
2015-02-12 14:44:06,074 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:06,074 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:06,076 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51304, dest: /127.0.0.1:50549, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075, duration: 5053000
2015-02-12 14:44:06,077 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:06,078 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:06,078 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51303, dest: /127.0.0.1:50539, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_918200777_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075, duration: 7447000
2015-02-12 14:44:06,078 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:06,079 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:06,081 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_918200777_1
2015-02-12 14:44:06,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:06,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:06,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:06,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:06,103 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0006_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:44:06,104 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:44:06,104 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0006 with final state: FINISHING
2015-02-12 14:44:06,105 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from RUNNING to FINAL_SAVING
2015-02-12 14:44:06,105 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0006
2015-02-12 14:44:06,105 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:44:06,106 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from FINAL_SAVING to FINISHING
2015-02-12 14:44:06,884 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:06,885 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:44:06,885 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000007
2015-02-12 14:44:06,885 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:06,885 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000007 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:07,109 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0006 unregistered successfully.
2015-02-12 14:44:07,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:44:07,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:44:07,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:44:07,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741892_1068 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:44:07,115 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741894_1070 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:44:07,115 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741895_1071 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:44:07,115 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:44:07,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0006 dst=null perm=null proto=rpc
2015-02-12 14:44:07,155 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] starting step: (1/2) ...tform/cogroupacogroupopt2
2015-02-12 14:44:07,179 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:44:07,193 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:44:07,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:07,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:07,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:07,204 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 7
2015-02-12 14:44:07,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007 dst=null perm=null proto=rpc
2015-02-12 14:44:07,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:44:07,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:44:07,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,213 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:44:07,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 src: /127.0.0.1:51308 dest: /127.0.0.1:50543
2015-02-12 14:44:07,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 src: /127.0.0.1:51309 dest: /127.0.0.1:50549
2015-02-12 14:44:07,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 src: /127.0.0.1:51310 dest: /127.0.0.1:50546
2015-02-12 14:44:07,224 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51310, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076, duration: 2811000
2015-02-12 14:44:07,225 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:07,225 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,225 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51309, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076, duration: 2988000
2015-02-12 14:44:07,226 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,227 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51308, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076, duration: 5222000
2015-02-12 14:44:07,227 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,231 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,233 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:07,234 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar
2015-02-12 14:44:07,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:44:07,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:44:07,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:07,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:44:07,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:44:07,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:07,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:07,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:07,252 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:07,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:07,253 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:07,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:07,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:07,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:07,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:07,259 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:07,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:07,261 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:07,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:07,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,268 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split
2015-02-12 14:44:07,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:07,270 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:44:07,272 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077 src: /127.0.0.1:51311 dest: /127.0.0.1:50549
2015-02-12 14:44:07,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077 src: /127.0.0.1:51312 dest: /127.0.0.1:50546
2015-02-12 14:44:07,274 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077 src: /127.0.0.1:51313 dest: /127.0.0.1:50539
2015-02-12 14:44:07,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077 src: /127.0.0.1:51314 dest: /127.0.0.1:50543
2015-02-12 14:44:07,278 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51314, dest: /127.0.0.1:50543, bytes: 1773, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, duration: 1604000
2015-02-12 14:44:07,279 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:07,279 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:44:07,280 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51313, dest: /127.0.0.1:50539, bytes: 1773, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, duration: 2306000
2015-02-12 14:44:07,281 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,283 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51312, dest: /127.0.0.1:50546, bytes: 1773, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, duration: 5330000
2015-02-12 14:44:07,283 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,283 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,284 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51311, dest: /127.0.0.1:50549, bytes: 1773, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, duration: 6873000
2015-02-12 14:44:07,285 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,286 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,287 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:07,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,296 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:44:07,298 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078 src: /127.0.0.1:51315 dest: /127.0.0.1:50539
2015-02-12 14:44:07,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078 src: /127.0.0.1:51316 dest: /127.0.0.1:50543
2015-02-12 14:44:07,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078 src: /127.0.0.1:51317 dest: /127.0.0.1:50546
2015-02-12 14:44:07,307 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51317, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078, duration: 1260000
2015-02-12 14:44:07,307 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:07,308 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51316, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078, duration: 1834000
2015-02-12 14:44:07,308 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,309 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:44:07,310 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51315, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078, duration: 3659000
2015-02-12 14:44:07,310 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,311 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:44:07,312 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:44:07,314 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:07,314 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:44:07,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:07,333 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:44:07,336 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079 src: /127.0.0.1:51318 dest: /127.0.0.1:50543
2015-02-12 14:44:07,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079 src: /127.0.0.1:51319 dest: /127.0.0.1:50546
2015-02-12 14:44:07,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079 src: /127.0.0.1:51320 dest: /127.0.0.1:50539
2015-02-12 14:44:07,347 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51320, dest: /127.0.0.1:50539, bytes: 98221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079, duration: 2849000
2015-02-12 14:44:07,347 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:07,349 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:44:07,349 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51319, dest: /127.0.0.1:50546, bytes: 98221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079, duration: 3418000
2015-02-12 14:44:07,349 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,350 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,350 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51318, dest: /127.0.0.1:50543, bytes: 98221, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079, duration: 4650000
2015-02-12 14:44:07,350 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:07,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:07,361 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:07,361 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0007
2015-02-12 14:44:07,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007 dst=null perm=null proto=rpc
2015-02-12 14:44:07,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:07,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:07,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:07,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:07,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:07,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:07,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,379 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 7 submitted by user soberoi
2015-02-12 14:44:07,379 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0007
2015-02-12 14:44:07,379 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from NEW to NEW_SAVING
2015-02-12 14:44:07,379 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0007
2015-02-12 14:44:07,379 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0007
2015-02-12 14:44:07,379 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:44:07,380 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0007 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:44:07,380 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from SUBMITTED to ACCEPTED
2015-02-12 14:44:07,380 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0007_000001
2015-02-12 14:44:07,380 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from NEW to SUBMITTED
2015-02-12 14:44:07,381 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0007_000001 to scheduler from user: soberoi
2015-02-12 14:44:07,381 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:44:07,381 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0007
2015-02-12 14:44:07,384 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0007/
2015-02-12 14:44:07,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] submitted hadoop job: job_1423780884992_0007
2015-02-12 14:44:07,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0007/
2015-02-12 14:44:07,556 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:07,557 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000001
2015-02-12 14:44:07,557 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:44:07,557 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0007_01_000001
2015-02-12 14:44:07,558 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:07,558 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0007_000001
2015-02-12 14:44:07,558 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0007 AttemptId: appattempt_1423780884992_0007_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0007_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:44:07,559 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:44:07,559 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:44:07,559 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0007_000001
2015-02-12 14:44:07,560 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0007_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0007_000001
2015-02-12 14:44:07,560 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:44:07,561 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0007_000001
2015-02-12 14:44:07,561 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0007_000001
2015-02-12 14:44:07,563 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:07,565 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000001 by user soberoi
2015-02-12 14:44:07,565 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0007
2015-02-12 14:44:07,565 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000001
2015-02-12 14:44:07,566 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from NEW to INITING
2015-02-12 14:44:07,566 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000001 to application application_1423780884992_0007
2015-02-12 14:44:07,566 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from INITING to RUNNING
2015-02-12 14:44:07,566 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0007_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0007_000001
2015-02-12 14:44:07,566 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:44:07,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:44:07,567 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:07,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:07,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:44:07,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:44:07,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:07,568 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0007_01_000001
2015-02-12 14:44:07,577 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0007_01_000001.tokens. Credentials list:
2015-02-12 14:44:07,687 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:07,780 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000001.tokens
2015-02-12 14:44:07,780 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:07,888 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:07,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:07,933 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:07,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:07,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:07,998 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0007/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:08,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:08,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:08,059 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:08,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:08,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:08,120 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0007/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:08,120 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:08,160 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:08,160 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:08,257 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000001/default_container_executor.sh]
2015-02-12 14:44:08,559 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:08,890 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:09,526 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:44:09,526 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:44:09,618 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073741900_1076 to datanode(s) 127.0.0.1:50539
2015-02-12 14:44:09,618 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741892_1068, blk_1073741893_1069, blk_1073741894_1070, blk_1073741895_1071]
2015-02-12 14:44:09,618 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741894_1070]
2015-02-12 14:44:09,893 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:10,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:10,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:44:10,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:44:10,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:44:10,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007 dst=null perm=null proto=rpc
2015-02-12 14:44:10,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:44:10,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:10,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 14:44:10,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 14:44:10,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741893 for deletion
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741894 for deletion
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741895 for deletion
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 14:44:10,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 14:44:10,481 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 14:44:10,481 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741893
2015-02-12 14:44:10,481 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741894
2015-02-12 14:44:10,481 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741895
2015-02-12 14:44:10,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:10,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:10,898 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:11,120 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 to 127.0.0.1:50539
2015-02-12 14:44:11,121 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 14:44:11,121 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 14:44:11,121 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 14:44:11,121 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741894 for deletion
2015-02-12 14:44:11,122 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 14:44:11,122 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 14:44:11,123 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 14:44:11,123 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741894
2015-02-12 14:44:11,125 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:44:11,126 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 src: /127.0.0.1:51330 dest: /127.0.0.1:50539
2015-02-12 14:44:11,128 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076 src: /127.0.0.1:51330 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:44:11,129 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741900_1076 size 254067
2015-02-12 14:44:11,286 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074
2015-02-12 14:44:11,287 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072
2015-02-12 14:44:11,287 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073
2015-02-12 14:44:11,569 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:11,572 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0007_000001
2015-02-12 14:44:11,572 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0007 APPATTEMPTID=appattempt_1423780884992_0007_000001
2015-02-12 14:44:11,572 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:44:11,572 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from ACCEPTED to RUNNING
2015-02-12 14:44:11,622 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073
2015-02-12 14:44:11,623 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071
2015-02-12 14:44:11,624 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075
2015-02-12 14:44:11,625 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074
2015-02-12 14:44:11,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:11,665 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072
2015-02-12 14:44:11,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:44:11,666 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741898_1074
2015-02-12 14:44:11,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741897_1073
2015-02-12 14:44:11,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741895_1071
2015-02-12 14:44:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075
2015-02-12 14:44:11,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:11,899 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:12,093 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:44:12,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741899_1075
2015-02-12 14:44:12,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741896_1072
2015-02-12 14:44:12,150 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080 src: /127.0.0.1:51334 dest: /127.0.0.1:50549
2015-02-12 14:44:12,152 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080 src: /127.0.0.1:51335 dest: /127.0.0.1:50543
2015-02-12 14:44:12,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080 src: /127.0.0.1:51336 dest: /127.0.0.1:50546
2015-02-12 14:44:12,188 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0006_01_000001 succeeded
2015-02-12 14:44:12,188 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:44:12,188 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0006_01_000001
2015-02-12 14:44:12,200 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51336, dest: /127.0.0.1:50546, bytes: 114960, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080, duration: 42896000
2015-02-12 14:44:12,200 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:12,202 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51335, dest: /127.0.0.1:50543, bytes: 114960, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080, duration: 44799000
2015-02-12 14:44:12,202 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:12,204 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51334, dest: /127.0.0.1:50549, bytes: 114960, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080, duration: 47400000
2015-02-12 14:44:12,205 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:12,205 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:12,206 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:12,207 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:12,212 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:12,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000001
2015-02-12 14:44:12,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000001
2015-02-12 14:44:12,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000001
2015-02-12 14:44:12,214 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000001
2015-02-12 14:44:12,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0006/container_1423780884992_0006_01_000001
2015-02-12 14:44:12,214 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0006_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:44:12,214 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0006_01_000001 from application application_1423780884992_0006
2015-02-12 14:44:12,214 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:12,214 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0006
2015-02-12 14:44:12,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:12,256 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:44:12,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081 src: /127.0.0.1:51337 dest: /127.0.0.1:50549
2015-02-12 14:44:12,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081 src: /127.0.0.1:51338 dest: /127.0.0.1:50546
2015-02-12 14:44:12,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081 src: /127.0.0.1:51339 dest: /127.0.0.1:50539
2015-02-12 14:44:12,265 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51339, dest: /127.0.0.1:50539, bytes: 394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081, duration: 1786000
2015-02-12 14:44:12,266 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:12,266 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:12,267 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51338, dest: /127.0.0.1:50546, bytes: 394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081, duration: 2749000
2015-02-12 14:44:12,267 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:12,269 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51337, dest: /127.0.0.1:50549, bytes: 394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081, duration: 5671000
2015-02-12 14:44:12,270 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:12,270 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:12,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:12,275 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007.summary is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:12,570 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0006_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:12,570 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0006_000001
2015-02-12 14:44:12,570 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0006_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:44:12,571 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0006_000001
2015-02-12 14:44:12,571 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0006_000001 State change from FINISHING to FINISHED
2015-02-12 14:44:12,571 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0006 State change from FINISHING to FINISHED
2015-02-12 14:44:12,571 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000001
2015-02-12 14:44:12,572 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0006
2015-02-12 14:44:12,572 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:44:12,572 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0006_000001 released container container_1423780884992_0006_01_000001 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:44:12,572 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0006_000001
2015-02-12 14:44:12,573 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0006_000001 is done. finalState=FINISHED
2015-02-12 14:44:12,573 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0006 requests cleared
2015-02-12 14:44:12,572 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0006,name=[80C3A20AF1A948A68997C481C5D46FFA/07C685EF9A824AA29756ED844EA0B75C] cogroupopt/(2/2),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0006/jobhistory/job/job_1423780884992_0006,appMasterHost=10.1.1.67,startTime=1423781023420,finishTime=1423781046104,finalStatus=SUCCEEDED
2015-02-12 14:44:12,576 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0006_000001 (auth:SIMPLE)
2015-02-12 14:44:12,578 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0006_01_000001
2015-02-12 14:44:12,578 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0006 CONTAINERID=container_1423780884992_0006_01_000001
2015-02-12 14:44:12,578 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0006_01_000001]
2015-02-12 14:44:12,579 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:12,579 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:12,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,580 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0006
2015-02-12 14:44:12,580 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:12,580 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0006, with delay of 10800 seconds
2015-02-12 14:44:12,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,581 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,582 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,619 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741892_1068, blk_1073741893_1069, blk_1073741895_1071]
2015-02-12 14:44:12,620 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741892_1068, blk_1073741893_1069, blk_1073741894_1070, blk_1073741895_1071]
2015-02-12 14:44:12,903 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:12,903 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:12,903 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:12,903 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000002
2015-02-12 14:44:12,904 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,904 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:12,904 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0006
2015-02-12 14:44:12,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,905 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:12,905 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0006, with delay of 10800 seconds
2015-02-12 14:44:12,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:12,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,047 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:13,047 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:13,047 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000003
2015-02-12 14:44:13,047 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:13,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,048 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0006
2015-02-12 14:44:13,049 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:13,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,049 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,049 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0006, with delay of 10800 seconds
2015-02-12 14:44:13,093 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:13,093 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:13,093 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000004
2015-02-12 14:44:13,093 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:13,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,094 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0006
2015-02-12 14:44:13,094 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:13,094 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0006, with delay of 10800 seconds
2015-02-12 14:44:13,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,095 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0006
2015-02-12 14:44:13,473 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 14:44:13,473 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 14:44:13,473 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 14:44:13,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 14:44:13,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 14:44:13,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741893 for deletion
2015-02-12 14:44:13,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741895 for deletion
2015-02-12 14:44:13,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 14:44:13,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 14:44:13,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741895
2015-02-12 14:44:13,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 14:44:13,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741893
2015-02-12 14:44:13,581 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:13,581 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000005
2015-02-12 14:44:13,581 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:44:13,631 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0007_01_000002
2015-02-12 14:44:13,632 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:13,632 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0007_01_000003
2015-02-12 14:44:13,632 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:13,632 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0007_01_000004
2015-02-12 14:44:13,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:13,633 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0007_01_000005
2015-02-12 14:44:13,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:13,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:13,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:13,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:13,793 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:13,794 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:13,794 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:13,796 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:13,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000002 by user soberoi
2015-02-12 14:44:13,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000004 by user soberoi
2015-02-12 14:44:13,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0007
2015-02-12 14:44:13,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0007
2015-02-12 14:44:13,798 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000002
2015-02-12 14:44:13,799 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from NEW to INITING
2015-02-12 14:44:13,799 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000004 to application application_1423780884992_0007
2015-02-12 14:44:13,799 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from INITING to RUNNING
2015-02-12 14:44:13,800 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000003 by user soberoi
2015-02-12 14:44:13,800 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0007
2015-02-12 14:44:13,800 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000003
2015-02-12 14:44:13,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000005 by user soberoi
2015-02-12 14:44:13,801 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000005
2015-02-12 14:44:13,803 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from NEW to INITING
2015-02-12 14:44:13,803 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000003 to application application_1423780884992_0007
2015-02-12 14:44:13,804 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from INITING to RUNNING
2015-02-12 14:44:13,805 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:44:13,805 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,805 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,805 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:13,806 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0007
2015-02-12 14:44:13,806 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:13,806 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:13,806 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0007_01_000003
2015-02-12 14:44:13,800 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:44:13,807 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,807 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,807 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:13,807 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000005 to application application_1423780884992_0007
2015-02-12 14:44:13,807 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:44:13,808 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,808 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,808 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:13,808 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0007
2015-02-12 14:44:13,808 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0007
2015-02-12 14:44:13,809 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:13,809 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:13,809 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0007_01_000004
2015-02-12 14:44:13,799 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from NEW to INITING
2015-02-12 14:44:13,810 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000002 to application application_1423780884992_0007
2015-02-12 14:44:13,799 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000004
2015-02-12 14:44:13,811 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from INITING to RUNNING
2015-02-12 14:44:13,811 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:44:13,812 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,812 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0007
2015-02-12 14:44:13,813 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:13,813 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0007
2015-02-12 14:44:13,814 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:13,816 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:13,817 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0007_01_000002
2015-02-12 14:44:13,809 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:13,845 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0007_01_000002.tokens. Credentials list:
2015-02-12 14:44:13,845 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0007_01_000003.tokens. Credentials list:
2015-02-12 14:44:13,852 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0007_01_000004.tokens. Credentials list:
2015-02-12 14:44:13,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 14:44:13,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 14:44:13,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 14:44:13,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741893 for deletion
2015-02-12 14:44:13,864 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741894 for deletion
2015-02-12 14:44:13,864 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741895 for deletion
2015-02-12 14:44:13,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 14:44:13,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 14:44:13,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 14:44:13,868 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741893
2015-02-12 14:44:13,868 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741894
2015-02-12 14:44:13,868 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741895
2015-02-12 14:44:13,894 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:13,895 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:13,904 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:13,905 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:13,905 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:13,905 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000006
2015-02-12 14:44:13,905 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:44:14,047 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:14,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:14,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:14,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:14,097 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:14,146 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000005/default_container_executor.sh]
2015-02-12 14:44:14,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0007_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000002.tokens
2015-02-12 14:44:14,279 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:14,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0007_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000003.tokens
2015-02-12 14:44:14,281 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:14,287 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0007_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000004.tokens
2015-02-12 14:44:14,287 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:14,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:14,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:14,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:14,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:14,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:14,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:14,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:14,533 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:14,543 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:14,583 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:14,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:14,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:14,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:14,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:14,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:14,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:14,644 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0007/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:14,644 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:14,650 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:14,656 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0007/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:14,657 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:14,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0007/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:14,662 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:14,667 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:14,669 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000006 by user soberoi
2015-02-12 14:44:14,670 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000006
2015-02-12 14:44:14,670 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000006 to application application_1423780884992_0007
2015-02-12 14:44:14,670 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:44:14,670 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:14,670 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0007
2015-02-12 14:44:14,670 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:14,671 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0007
2015-02-12 14:44:14,671 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:14,715 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:14,716 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:14,732 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:14,732 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:14,739 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:14,739 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:14,740 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:14,740 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:14,907 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:14,908 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:14,908 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000007
2015-02-12 14:44:14,908 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:44:14,958 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000003/default_container_executor.sh]
2015-02-12 14:44:14,969 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000006/default_container_executor.sh]
2015-02-12 14:44:14,970 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000002/default_container_executor.sh]
2015-02-12 14:44:14,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000004/default_container_executor.sh]
2015-02-12 14:44:15,657 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:44:15,658 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:16,295 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079
2015-02-12 14:44:16,295 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078
2015-02-12 14:44:16,297 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076
2015-02-12 14:44:16,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077
2015-02-12 14:44:16,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078
2015-02-12 14:44:16,662 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:44:16,662 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:44:16,662 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000007
2015-02-12 14:44:16,663 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:44:16,663 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000007 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:44:16,674 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741902_1078
2015-02-12 14:44:16,674 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077
2015-02-12 14:44:16,675 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079
2015-02-12 14:44:16,834 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076
2015-02-12 14:44:16,835 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741903_1079
2015-02-12 14:44:16,835 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077
2015-02-12 14:44:16,878 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076
2015-02-12 14:44:16,911 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0007_01_000007
2015-02-12 14:44:17,150 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741900_1076
2015-02-12 14:44:17,150 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741901_1077
2015-02-12 14:44:21,305 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080
2015-02-12 14:44:21,839 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081
2015-02-12 14:44:21,882 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080
2015-02-12 14:44:21,882 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081
2015-02-12 14:44:22,158 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741904_1080
2015-02-12 14:44:22,159 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741905_1081
2015-02-12 14:44:23,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:23,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:23,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:23,500 INFO hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 14:44:23,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:44:23,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:23,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,518 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0001,submitTime=1423780891452,launchTime=1423780896494,firstMapTaskLaunchTime=1423780898677,firstReduceTaskLaunchTime=1423780912618,finishTime=1423780915976,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=58,reduceSlotSeconds=3,jobName=[D1C3795DE98A405AB91B444FF9285EA0/447BBBFC9DF940A897F4002777F82764] lower*upper/(1/1) ...ipesplatform/cogroupinner
2015-02-12 14:44:23,518 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0002,submitTime=1423780917703,launchTime=1423780921873,firstMapTaskLaunchTime=1423780924049,firstReduceTaskLaunchTime=1423780937995,finishTime=1423780941231,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=56,reduceSlotSeconds=3,jobName=[DBD98C85320A4F75B48AA8064AA19438/43DDF72AAA05461EBB45B246E60430B9] lower*upper/(1/1) .../cogroupinner-resultgroup
2015-02-12 14:44:23,518 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary]
2015-02-12 14:44:23,518 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0003,submitTime=1423780942983,launchTime=1423780947178,firstMapTaskLaunchTime=1423780949497,firstReduceTaskLaunchTime=1423780970350,finishTime=1423780973543,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=9,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=169,reduceSlotSeconds=3,jobName=[A07C159BD56F40D48674C5E60F31D40A/E4A8C5C81781407F9BF90C24DF9C8B38] loweroffset*upper*lower/(1/1) ...ipesplatform/cogroupmixed
2015-02-12 14:44:23,519 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary]
2015-02-12 14:44:23,518 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary]
2015-02-12 14:44:23,520 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 630 Total time for transactions(ms): 70 Number of transactions batched in Syncs: 0 Number of syncs: 420 SyncTimes(ms): 146 93
2015-02-12 14:44:23,525 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:44:23,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,525 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741862_1038 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:44:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,526 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:44:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,543 INFO hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 14:44:23,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,543 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist
2015-02-12 14:44:23,544 INFO hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 14:44:23,544 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist
2015-02-12 14:44:23,544 INFO hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 14:44:23,544 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist
2015-02-12 14:44:23,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0001-1423780891452-soberoi-%5BD1C3795DE98A405AB91B444FF9285EA0%2F447BBBFC9DF940A8-1423780915976-5-1-SUCCEEDED-root.soberoi-1423780896494.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0002-1423780917703-soberoi-%5BDBD98C85320A4F75B48AA8064AA19438%2F43DDF72AAA05461E-1423780941231-5-1-SUCCEEDED-root.soberoi-1423780921873.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,556 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0001_conf.xml
2015-02-12 14:44:23,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0003-1423780942983-soberoi-%5BA07C159BD56F40D48674C5E60F31D40A%2FE4A8C5C81781407F-1423780973543-9-1-SUCCEEDED-root.soberoi-1423780947178.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,557 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0002_conf.xml
2015-02-12 14:44:23,557 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0003_conf.xml
2015-02-12 14:44:23,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0001_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0001_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0002_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0002_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0003_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0003_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,566 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0004,submitTime=1423780975126,launchTime=1423780979310,firstMapTaskLaunchTime=1423780981520,firstReduceTaskLaunchTime=1423780994427,finishTime=1423780997769,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[DB86A6863A8A403DB9E89675C167035F/6C5F38712FB040D9853166E8499BE8BB] lower*upper/(1/1) ...ipesplatform/cogroupouter
2015-02-12 14:44:23,566 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary]
2015-02-12 14:44:23,569 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0005,submitTime=1423780999364,launchTime=1423781003411,firstMapTaskLaunchTime=1423781005755,firstReduceTaskLaunchTime=1423781018552,finishTime=1423781021789,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=52,reduceSlotSeconds=3,jobName=[DEE6C0C8C50E4B18B707131922FC0A04/C2C7A9613B53416E86B29B6052860FC4] lower*upper/(1/1) .../cogroupouter-resultgroup
2015-02-12 14:44:23,569 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary]
2015-02-12 14:44:23,571 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741873_1049 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:44:23,571 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0006,submitTime=1423781023420,launchTime=1423781027710,firstMapTaskLaunchTime=1423781029922,firstReduceTaskLaunchTime=1423781042805,finishTime=1423781045944,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=54,reduceSlotSeconds=3,jobName=[80C3A20AF1A948A68997C481C5D46FFA/07C685EF9A824AA29756ED844EA0B75C] cogroupopt/(2/2)
2015-02-12 14:44:23,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,571 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary]
2015-02-12 14:44:23,574 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741884_1060 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:44:23,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,575 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:44:23,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006.summary dst=null perm=null proto=rpc
2015-02-12 14:44:23,577 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist
2015-02-12 14:44:23,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,579 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist
2015-02-12 14:44:23,580 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist
2015-02-12 14:44:23,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0004-1423780975126-soberoi-%5BDB86A6863A8A403DB9E89675C167035F%2F6C5F38712FB040D9-1423780997769-5-1-SUCCEEDED-root.soberoi-1423780979310.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,581 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0004_conf.xml
2015-02-12 14:44:23,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0005-1423780999364-soberoi-%5BDEE6C0C8C50E4B18B707131922FC0A04%2FC2C7A9613B53416E-1423781021789-5-1-SUCCEEDED-root.soberoi-1423781003411.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,581 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0005_conf.xml
2015-02-12 14:44:23,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0006-1423781023420-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F07C685EF9A824AA2-1423781045944-5-1-SUCCEEDED-root.soberoi-1423781027710.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0004_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0004_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,582 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0006_conf.xml
2015-02-12 14:44:23,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0005_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0005_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0006_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0006_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:23,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:23,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:23,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2015-02-12 14:44:23,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:23,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:23,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:24,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:44:24,402 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:24,404 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000005
2015-02-12 14:44:24,405 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000005
2015-02-12 14:44:24,405 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:44:24,405 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000005
2015-02-12 14:44:24,432 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0007_01_000005 is : 143
2015-02-12 14:44:24,441 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:24,442 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000005
2015-02-12 14:44:24,442 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:44:24,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000005
2015-02-12 14:44:24,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082 src: /127.0.0.1:51382 dest: /127.0.0.1:50543
2015-02-12 14:44:24,447 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000005
2015-02-12 14:44:24,451 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000005
2015-02-12 14:44:24,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082 src: /127.0.0.1:51383 dest: /127.0.0.1:50539
2015-02-12 14:44:24,451 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000005
2015-02-12 14:44:24,452 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:24,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082 src: /127.0.0.1:51384 dest: /127.0.0.1:50549
2015-02-12 14:44:24,453 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000005 from application application_1423780884992_0007
2015-02-12 14:44:24,453 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:24,455 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:24,465 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist for DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:24,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:44:24,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:24,569 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:24,571 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000006
2015-02-12 14:44:24,571 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000006
2015-02-12 14:44:24,571 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:44:24,571 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000006
2015-02-12 14:44:24,594 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0007_01_000006 is : 143
2015-02-12 14:44:24,603 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:24,603 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000006
2015-02-12 14:44:24,604 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:24,604 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000006 from application application_1423780884992_0007
2015-02-12 14:44:24,604 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:24,604 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:24,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000006
2015-02-12 14:44:24,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000006
2015-02-12 14:44:24,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000006
2015-02-12 14:44:24,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000006
2015-02-12 14:44:24,618 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:24,621 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000002
2015-02-12 14:44:24,622 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000002
2015-02-12 14:44:24,622 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:44:24,622 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000002
2015-02-12 14:44:24,624 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:24,624 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:44:24,624 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000006
2015-02-12 14:44:24,624 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:44:24,624 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000006 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:44:24,635 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741862_1038, blk_1073741848_1024, blk_1073741897_1073, blk_1073741884_1060, blk_1073741837_1013]
2015-02-12 14:44:24,635 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741873_1049, blk_1073741862_1038, blk_1073741848_1024, blk_1073741897_1073, blk_1073741884_1060]
2015-02-12 14:44:24,648 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0007_01_000002 is : 143
2015-02-12 14:44:24,657 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:24,657 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000002
2015-02-12 14:44:24,658 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000002
2015-02-12 14:44:24,658 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000002
2015-02-12 14:44:24,658 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:24,658 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000002 from application application_1423780884992_0007
2015-02-12 14:44:24,658 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:24,658 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:24,660 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000002
2015-02-12 14:44:24,660 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000002
2015-02-12 14:44:24,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:44:24,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:44:24,737 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:24,740 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000004
2015-02-12 14:44:24,741 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000004
2015-02-12 14:44:24,741 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:44:24,741 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000004
2015-02-12 14:44:24,763 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0007_01_000004 is : 143
2015-02-12 14:44:24,771 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:24,773 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000003
2015-02-12 14:44:24,773 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000003
2015-02-12 14:44:24,774 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:44:24,774 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000003
2015-02-12 14:44:24,774 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:24,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000004
2015-02-12 14:44:24,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000004
2015-02-12 14:44:24,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000004
2015-02-12 14:44:24,775 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000004
2015-02-12 14:44:24,776 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:24,776 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000004 from application application_1423780884992_0007
2015-02-12 14:44:24,776 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:24,777 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:24,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000004
2015-02-12 14:44:24,792 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0007_01_000003 is : 143
2015-02-12 14:44:24,801 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:24,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000003
2015-02-12 14:44:24,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000003
2015-02-12 14:44:24,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000003
2015-02-12 14:44:24,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000003
2015-02-12 14:44:24,806 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000003
2015-02-12 14:44:24,806 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:24,806 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000003 from application application_1423780884992_0007
2015-02-12 14:44:24,807 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:24,807 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:25,408 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:25,409 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:44:25,409 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000005
2015-02-12 14:44:25,409 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:44:25,409 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000005 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:44:25,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741873 for deletion
2015-02-12 14:44:25,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 14:44:25,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 14:44:25,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 14:44:25,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741873
2015-02-12 14:44:25,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 14:44:25,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 14:44:25,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 14:44:25,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 14:44:25,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 14:44:25,624 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:25,624 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:44:25,624 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000002
2015-02-12 14:44:25,625 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:25,625 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000002 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:25,625 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:25,747 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:25,747 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:44:25,748 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000004
2015-02-12 14:44:25,748 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:25,748 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:25,749 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:25,749 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000008
2015-02-12 14:44:25,749 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0007_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:25,779 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:25,779 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:44:25,779 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000003
2015-02-12 14:44:25,779 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:25,779 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000003 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:25,869 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 14:44:25,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 14:44:25,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 14:44:25,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 14:44:25,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 14:44:25,871 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 14:44:25,871 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 14:44:25,872 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 14:44:25,872 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 14:44:25,872 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 14:44:26,414 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:26,629 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0007_01_000006]
2015-02-12 14:44:26,629 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:26,629 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:26,720 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:26,731 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:26,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0007_01_000008 by user soberoi
2015-02-12 14:44:26,734 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000008
2015-02-12 14:44:26,734 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0007_01_000008 to application application_1423780884992_0007
2015-02-12 14:44:26,734 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:44:26,734 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0007
2015-02-12 14:44:26,734 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0007
2015-02-12 14:44:26,734 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:26,735 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0007
2015-02-12 14:44:26,735 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:26,748 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:26,748 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:26,765 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:26,765 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:26,781 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:26,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000008/default_container_executor.sh]
2015-02-12 14:44:27,416 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0007_01_000005]
2015-02-12 14:44:27,416 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:27,635 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0007_01_000002]
2015-02-12 14:44:27,635 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:27,640 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741873_1049, blk_1073741862_1038, blk_1073741897_1073, blk_1073741837_1013]
2015-02-12 14:44:27,640 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741873_1049, blk_1073741848_1024, blk_1073741884_1060, blk_1073741837_1013]
2015-02-12 14:44:27,725 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:44:27,751 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0007_01_000004]
2015-02-12 14:44:27,752 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:27,782 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0007_01_000003]
2015-02-12 14:44:27,782 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:28,490 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741873 for deletion
2015-02-12 14:44:28,490 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 14:44:28,490 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 14:44:28,491 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 14:44:28,491 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741873
2015-02-12 14:44:28,491 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 14:44:28,491 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 14:44:28,492 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 14:44:29,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741873 for deletion
2015-02-12 14:44:29,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 14:44:29,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 14:44:29,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741873
2015-02-12 14:44:29,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 14:44:29,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 14:44:29,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 14:44:29,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 14:44:29,315 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:29,319 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:29,323 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:29,326 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:29,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:29,635 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:44:29,733 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083 src: /127.0.0.1:51410 dest: /127.0.0.1:50543
2015-02-12 14:44:29,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083 src: /127.0.0.1:51411 dest: /127.0.0.1:50546
2015-02-12 14:44:29,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083 src: /127.0.0.1:51412 dest: /127.0.0.1:50549
2015-02-12 14:44:29,771 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51412, dest: /127.0.0.1:50549, bytes: 63, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0007_r_000000_0_-1178665313_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083, duration: 31674000
2015-02-12 14:44:29,772 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:29,774 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51411, dest: /127.0.0.1:50546, bytes: 63, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0007_r_000000_0_-1178665313_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083, duration: 33723000
2015-02-12 14:44:29,774 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:29,776 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51410, dest: /127.0.0.1:50543, bytes: 63, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0007_r_000000_0_-1178665313_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083, duration: 36293000
2015-02-12 14:44:29,777 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:29,785 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:44:29,786 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0007_r_000000_0_-1178665313_1
2015-02-12 14:44:29,787 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741907_1083 size 63
2015-02-12 14:44:29,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741907_1083 size 63
2015-02-12 14:44:29,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:29,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:29,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/task_1423780884992_0007_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:44:29,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/_temporary/attempt_1423780884992_0007_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/task_1423780884992_0007_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:44:29,838 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:29,842 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000008
2015-02-12 14:44:29,842 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000008
2015-02-12 14:44:29,842 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:44:29,842 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000008
2015-02-12 14:44:29,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:29,859 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:29,876 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0007_01_000008 is : 143
2015-02-12 14:44:29,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:44:29,880 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:29,883 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000008
2015-02-12 14:44:29,883 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:29,883 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000008 from application application_1423780884992_0007
2015-02-12 14:44:29,883 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:29,884 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:29,888 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000008
2015-02-12 14:44:29,890 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000008
2015-02-12 14:44:29,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000008
2015-02-12 14:44:29,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000008
2015-02-12 14:44:29,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:29,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:29,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/task_1423780884992_0007_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:44:29,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:29,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary/1/task_1423780884992_0007_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:29,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary dst=null perm=null proto=rpc
2015-02-12 14:44:29,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:29,928 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:29,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:29,934 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:29,956 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51384, dest: /127.0.0.1:50549, bytes: 69143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082, duration: 5498391000
2015-02-12 14:44:29,957 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:29,961 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16370
2015-02-12 14:44:29,961 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51383, dest: /127.0.0.1:50539, bytes: 69143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082, duration: 5503198000
2015-02-12 14:44:29,961 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:29,962 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51382, dest: /127.0.0.1:50543, bytes: 69143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082, duration: 5504312000
2015-02-12 14:44:29,963 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:29,966 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:29,966 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741906_1082 size 69143
2015-02-12 14:44:29,966 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741906_1082 size 69143
2015-02-12 14:44:29,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:29,972 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:44:29,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084 src: /127.0.0.1:51414 dest: /127.0.0.1:50539
2015-02-12 14:44:29,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084 src: /127.0.0.1:51415 dest: /127.0.0.1:50543
2015-02-12 14:44:29,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084 src: /127.0.0.1:51416 dest: /127.0.0.1:50549
2015-02-12 14:44:29,983 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51416, dest: /127.0.0.1:50549, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084, duration: 3243000
2015-02-12 14:44:29,983 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:29,984 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:29,984 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51415, dest: /127.0.0.1:50543, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084, duration: 2940000
2015-02-12 14:44:29,984 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:29,985 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:29,985 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51414, dest: /127.0.0.1:50539, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084, duration: 4107000
2015-02-12 14:44:29,985 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:29,986 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:29,989 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:29,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:30,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:30,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:30,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:30,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:30,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:30,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:30,022 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:44:30,025 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085 src: /127.0.0.1:51418 dest: /127.0.0.1:50539
2015-02-12 14:44:30,026 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085 src: /127.0.0.1:51419 dest: /127.0.0.1:50549
2015-02-12 14:44:30,027 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085 src: /127.0.0.1:51420 dest: /127.0.0.1:50543
2015-02-12 14:44:30,032 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51420, dest: /127.0.0.1:50543, bytes: 69143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085, duration: 1965000
2015-02-12 14:44:30,033 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:30,034 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:44:30,034 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51419, dest: /127.0.0.1:50549, bytes: 69143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085, duration: 3956000
2015-02-12 14:44:30,035 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:30,036 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:30,036 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51418, dest: /127.0.0.1:50539, bytes: 69143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085, duration: 6218000
2015-02-12 14:44:30,036 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:30,037 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:30,039 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:30,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:30,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:30,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:30,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:30,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:30,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007/job_1423780884992_0007_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:30,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:30,068 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:44:30,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086 src: /127.0.0.1:51421 dest: /127.0.0.1:50543
2015-02-12 14:44:30,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086 src: /127.0.0.1:51422 dest: /127.0.0.1:50539
2015-02-12 14:44:30,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086 src: /127.0.0.1:51423 dest: /127.0.0.1:50546
2015-02-12 14:44:30,080 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51423, dest: /127.0.0.1:50546, bytes: 114960, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086, duration: 3580000
2015-02-12 14:44:30,082 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:30,084 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:30,084 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51422, dest: /127.0.0.1:50539, bytes: 114960, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086, duration: 7243000
2015-02-12 14:44:30,084 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:30,085 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:30,085 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51421, dest: /127.0.0.1:50543, bytes: 114960, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1417186520_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086, duration: 8483000
2015-02-12 14:44:30,086 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:30,087 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:30,090 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1417186520_1
2015-02-12 14:44:30,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:30,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:30,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:30,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:30,114 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0007_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:44:30,114 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:44:30,114 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0007 with final state: FINISHING
2015-02-12 14:44:30,114 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from RUNNING to FINAL_SAVING
2015-02-12 14:44:30,115 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:44:30,115 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0007
2015-02-12 14:44:30,115 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from FINAL_SAVING to FINISHING
2015-02-12 14:44:30,846 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:30,847 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:44:30,847 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000008
2015-02-12 14:44:30,847 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:30,847 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000008 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:31,120 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0007 unregistered successfully.
2015-02-12 14:44:31,124 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741900_1076 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:44:31,125 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741901_1077 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:44:31,125 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741902_1078 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:44:31,125 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741903_1079 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:44:31,125 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:44:31,126 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741906_1082 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:44:31,126 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741904_1080 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:44:31,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0007 dst=null perm=null proto=rpc
2015-02-12 14:44:31,164 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741896_1072 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:44:31,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/7241049223_source20_source101_63FDE2BCD65B4431B9E8FFDBB3815C89 dst=null perm=null proto=rpc
2015-02-12 14:44:31,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,166 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary
2015-02-12 14:44:31,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/_temporary dst=null perm=null proto=rpc
2015-02-12 14:44:31,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,185 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:31,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:31,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,207 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:31,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:31,211 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2
2015-02-12 14:44:31,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2 dst=null perm=null proto=rpc
2015-02-12 14:44:31,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:31,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:31,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,237 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:44:31,237 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:44:31,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:44:31,265 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] starting
2015-02-12 14:44:31,265 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] source: Hfs["TextDelimited[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt"]
2015-02-12 14:44:31,265 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] source: Hfs["TextDelimited[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt"]
2015-02-12 14:44:31,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] source: Hfs["TextDelimited[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt"]
2015-02-12 14:44:31,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1"]
2015-02-12 14:44:31,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] parallel execution is enabled: true
2015-02-12 14:44:31,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] starting jobs: 2
2015-02-12 14:44:31,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogroupopt] allocating threads: 2
2015-02-12 14:44:31,267 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] starting step: (2/2)
2015-02-12 14:44:31,278 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:44:31,289 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:44:31,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:31,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:31,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:31,296 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 8
2015-02-12 14:44:31,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008 dst=null perm=null proto=rpc
2015-02-12 14:44:31,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:44:31,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:44:31,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,311 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:44:31,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 src: /127.0.0.1:51428 dest: /127.0.0.1:50549
2015-02-12 14:44:31,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 src: /127.0.0.1:51429 dest: /127.0.0.1:50546
2015-02-12 14:44:31,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 src: /127.0.0.1:51430 dest: /127.0.0.1:50539
2015-02-12 14:44:31,335 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51430, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087, duration: 4129000
2015-02-12 14:44:31,335 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:31,338 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51429, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087, duration: 8493000
2015-02-12 14:44:31,338 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,340 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51428, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087, duration: 11150000
2015-02-12 14:44:31,341 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,343 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,343 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,344 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741911_1087 size 254067
2015-02-12 14:44:31,345 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:31,346 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar
2015-02-12 14:44:31,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:44:31,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:44:31,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:31,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:44:31,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:44:31,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,368 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:31,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,374 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:31,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,379 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:31,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,382 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:31,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:31,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,390 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split
2015-02-12 14:44:31,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:31,392 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:44:31,394 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088 src: /127.0.0.1:51431 dest: /127.0.0.1:50539
2015-02-12 14:44:31,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088 src: /127.0.0.1:51432 dest: /127.0.0.1:50546
2015-02-12 14:44:31,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088 src: /127.0.0.1:51433 dest: /127.0.0.1:50549
2015-02-12 14:44:31,398 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088 src: /127.0.0.1:51434 dest: /127.0.0.1:50543
2015-02-12 14:44:31,401 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51434, dest: /127.0.0.1:50543, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, duration: 1690000
2015-02-12 14:44:31,402 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:31,402 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:44:31,402 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51433, dest: /127.0.0.1:50549, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, duration: 2426000
2015-02-12 14:44:31,403 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,403 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,404 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51432, dest: /127.0.0.1:50546, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, duration: 3650000
2015-02-12 14:44:31,404 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,404 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,405 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51431, dest: /127.0.0.1:50539, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, duration: 4611000
2015-02-12 14:44:31,405 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,407 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,408 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:31,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,413 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:44:31,416 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089 src: /127.0.0.1:51435 dest: /127.0.0.1:50546
2015-02-12 14:44:31,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089 src: /127.0.0.1:51436 dest: /127.0.0.1:50549
2015-02-12 14:44:31,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089 src: /127.0.0.1:51437 dest: /127.0.0.1:50539
2015-02-12 14:44:31,424 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51437, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089, duration: 1816000
2015-02-12 14:44:31,424 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:31,425 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,426 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51436, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089, duration: 3417000
2015-02-12 14:44:31,427 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,427 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,428 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51435, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089, duration: 5943000
2015-02-12 14:44:31,429 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,431 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,433 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:31,433 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:44:31,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:31,449 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:44:31,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090 src: /127.0.0.1:51438 dest: /127.0.0.1:50539
2015-02-12 14:44:31,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090 src: /127.0.0.1:51439 dest: /127.0.0.1:50543
2015-02-12 14:44:31,455 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090 src: /127.0.0.1:51440 dest: /127.0.0.1:50549
2015-02-12 14:44:31,458 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51440, dest: /127.0.0.1:50549, bytes: 97226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090, duration: 1933000
2015-02-12 14:44:31,458 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:31,459 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:44:31,459 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51439, dest: /127.0.0.1:50543, bytes: 97226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090, duration: 2338000
2015-02-12 14:44:31,459 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,460 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:44:31,460 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51438, dest: /127.0.0.1:50539, bytes: 97226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090, duration: 3322000
2015-02-12 14:44:31,460 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:31,462 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:31,463 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:31,463 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0008
2015-02-12 14:44:31,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008 dst=null perm=null proto=rpc
2015-02-12 14:44:31,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:31,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:31,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:31,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:31,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:31,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:31,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,493 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 8 submitted by user soberoi
2015-02-12 14:44:31,494 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0008
2015-02-12 14:44:31,493 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0008
2015-02-12 14:44:31,494 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from NEW to NEW_SAVING
2015-02-12 14:44:31,494 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0008
2015-02-12 14:44:31,494 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:44:31,495 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0008 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:44:31,495 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from SUBMITTED to ACCEPTED
2015-02-12 14:44:31,495 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0008_000001
2015-02-12 14:44:31,495 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0008
2015-02-12 14:44:31,495 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from NEW to SUBMITTED
2015-02-12 14:44:31,496 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0008_000001 to scheduler from user: soberoi
2015-02-12 14:44:31,496 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:44:31,499 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0008/
2015-02-12 14:44:31,499 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] submitted hadoop job: job_1423780884992_0008
2015-02-12 14:44:31,499 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0008/
2015-02-12 14:44:31,651 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:31,652 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000001
2015-02-12 14:44:31,652 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:44:31,652 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0008_01_000001
2015-02-12 14:44:31,653 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:31,653 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0008_000001
2015-02-12 14:44:31,653 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0008 AttemptId: appattempt_1423780884992_0008_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0008_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:44:31,653 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:44:31,654 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:44:31,654 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0008_000001
2015-02-12 14:44:31,655 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0008_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0008_000001
2015-02-12 14:44:31,655 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0008_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:44:31,655 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0008_000001
2015-02-12 14:44:31,655 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0008_000001
2015-02-12 14:44:31,658 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:31,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000001 by user soberoi
2015-02-12 14:44:31,660 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0008
2015-02-12 14:44:31,660 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000001
2015-02-12 14:44:31,660 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from NEW to INITING
2015-02-12 14:44:31,660 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000001 to application application_1423780884992_0008
2015-02-12 14:44:31,660 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0008_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0008_000001
2015-02-12 14:44:31,660 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from INITING to RUNNING
2015-02-12 14:44:31,661 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:44:31,661 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:44:31,661 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:31,661 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:31,661 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:44:31,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:44:31,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:31,662 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0008_01_000001
2015-02-12 14:44:31,671 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0008_01_000001.tokens. Credentials list:
2015-02-12 14:44:31,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:31,850 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:31,885 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0008_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000001.tokens
2015-02-12 14:44:31,886 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:44:31,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:31,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:32,017 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:32,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:32,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:32,078 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0008/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:32,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:32,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:32,139 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:32,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:32,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:32,209 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0008/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:32,209 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:32,263 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:32,263 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:32,388 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000001/default_container_executor.sh]
2015-02-12 14:44:32,655 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:32,855 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:33,643 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073741911_1087 to datanode(s) 127.0.0.1:50543
2015-02-12 14:44:33,643 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741896_1072, blk_1073741900_1076, blk_1073741901_1077, blk_1073741902_1078, blk_1073741903_1079]
2015-02-12 14:44:33,643 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741904_1080, blk_1073741906_1082, blk_1073741896_1072, blk_1073741900_1076, blk_1073741901_1077, blk_1073741902_1078, blk_1073741903_1079]
2015-02-12 14:44:33,858 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:34,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:34,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:44:34,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:44:34,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:44:34,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008 dst=null perm=null proto=rpc
2015-02-12 14:44:34,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:44:34,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:34,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 14:44:34,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 14:44:34,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741896 for deletion
2015-02-12 14:44:34,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 14:44:34,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 14:44:34,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 14:44:34,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 14:44:34,495 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 14:44:34,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741902 for deletion
2015-02-12 14:44:34,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741903 for deletion
2015-02-12 14:44:34,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741896
2015-02-12 14:44:34,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741902
2015-02-12 14:44:34,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 14:44:34,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741903
2015-02-12 14:44:34,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:34,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:34,862 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:34,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 14:44:34,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741905 for deletion
2015-02-12 14:44:34,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741896 for deletion
2015-02-12 14:44:34,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 14:44:34,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 14:44:34,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741905
2015-02-12 14:44:34,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 14:44:34,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741902 for deletion
2015-02-12 14:44:34,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741903 for deletion
2015-02-12 14:44:34,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 14:44:34,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741896
2015-02-12 14:44:34,877 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741903
2015-02-12 14:44:34,877 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 14:44:34,877 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741902
2015-02-12 14:44:35,142 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 to 127.0.0.1:50543
2015-02-12 14:44:35,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 src: /127.0.0.1:51449 dest: /127.0.0.1:50543
2015-02-12 14:44:35,144 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:44:35,145 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087 src: /127.0.0.1:51449 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:44:35,146 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741911_1087 size 254067
2015-02-12 14:44:35,663 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:35,666 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0008_000001
2015-02-12 14:44:35,666 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0008 APPATTEMPTID=appattempt_1423780884992_0008_000001
2015-02-12 14:44:35,666 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:44:35,667 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from ACCEPTED to RUNNING
2015-02-12 14:44:35,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:35,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:44:35,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:35,866 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:36,059 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:44:36,108 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091 src: /127.0.0.1:51453 dest: /127.0.0.1:50546
2015-02-12 14:44:36,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091 src: /127.0.0.1:51454 dest: /127.0.0.1:50543
2015-02-12 14:44:36,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091 src: /127.0.0.1:51455 dest: /127.0.0.1:50549
2015-02-12 14:44:36,148 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51455, dest: /127.0.0.1:50549, bytes: 114079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091, duration: 34618000
2015-02-12 14:44:36,148 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:36,149 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:36,149 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51454, dest: /127.0.0.1:50543, bytes: 114079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091, duration: 35500000
2015-02-12 14:44:36,149 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:36,150 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51453, dest: /127.0.0.1:50546, bytes: 114079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091, duration: 36947000
2015-02-12 14:44:36,150 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:36,151 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:36,154 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:36,163 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:36,177 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0007_01_000001 succeeded
2015-02-12 14:44:36,177 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:44:36,178 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0007_01_000001
2015-02-12 14:44:36,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:36,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000001
2015-02-12 14:44:36,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000001
2015-02-12 14:44:36,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000001
2015-02-12 14:44:36,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007/container_1423780884992_0007_01_000001
2015-02-12 14:44:36,215 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000001
2015-02-12 14:44:36,218 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:44:36,219 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0007_01_000001 from application application_1423780884992_0007
2015-02-12 14:44:36,219 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:36,219 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0007
2015-02-12 14:44:36,260 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:44:36,263 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092 src: /127.0.0.1:51456 dest: /127.0.0.1:50546
2015-02-12 14:44:36,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092 src: /127.0.0.1:51457 dest: /127.0.0.1:50539
2015-02-12 14:44:36,269 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092 src: /127.0.0.1:51458 dest: /127.0.0.1:50549
2015-02-12 14:44:36,272 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51458, dest: /127.0.0.1:50549, bytes: 365, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092, duration: 1810000
2015-02-12 14:44:36,272 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:36,273 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:36,273 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51457, dest: /127.0.0.1:50539, bytes: 365, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092, duration: 2464000
2015-02-12 14:44:36,273 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:36,274 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:36,274 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51456, dest: /127.0.0.1:50546, bytes: 365, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092, duration: 3483000
2015-02-12 14:44:36,274 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:36,275 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:36,287 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008.summary is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:36,317 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086
2015-02-12 14:44:36,318 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085
2015-02-12 14:44:36,318 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083
2015-02-12 14:44:36,319 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084
2015-02-12 14:44:36,436 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:36,436 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0007_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:44:36,436 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0007_000001
2015-02-12 14:44:36,437 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0007_000001
2015-02-12 14:44:36,437 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0007_000001 State change from FINISHING to FINISHED
2015-02-12 14:44:36,436 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000001
2015-02-12 14:44:36,437 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:36,438 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0007_000001 released container container_1423780884992_0007_01_000001 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:36,437 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0007 State change from FINISHING to FINISHED
2015-02-12 14:44:36,438 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0007
2015-02-12 14:44:36,438 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0007,name=[80C3A20AF1A948A68997C481C5D46FFA/0ED9A8A56B8147359D8BCD2900A4B8A0] cogroupopt/(1/2) ...tform/cogroupacogroupopt2,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0007/jobhistory/job/job_1423780884992_0007,appMasterHost=10.1.1.67,startTime=1423781047378,finishTime=1423781070114,finalStatus=SUCCEEDED
2015-02-12 14:44:36,439 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0007_000001 is done. finalState=FINISHED
2015-02-12 14:44:36,439 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0007 requests cleared
2015-02-12 14:44:36,439 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0007_000001
2015-02-12 14:44:36,442 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0007_000001 (auth:SIMPLE)
2015-02-12 14:44:36,444 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0007_01_000001
2015-02-12 14:44:36,444 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0007 CONTAINERID=container_1423780884992_0007_01_000001
2015-02-12 14:44:36,445 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0007_01_000001]
2015-02-12 14:44:36,445 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:36,445 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:36,445 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,445 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,446 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0007
2015-02-12 14:44:36,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,446 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:36,446 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0007, with delay of 10800 seconds
2015-02-12 14:44:36,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,646 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741905_1081, blk_1073741906_1082, blk_1073741900_1076, blk_1073741901_1077, blk_1073741902_1078, blk_1073741903_1079]
2015-02-12 14:44:36,646 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741896_1072, blk_1073741900_1076, blk_1073741901_1077]
2015-02-12 14:44:36,669 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:36,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,670 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,670 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0007
2015-02-12 14:44:36,670 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,671 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:36,671 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0007, with delay of 10800 seconds
2015-02-12 14:44:36,670 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,806 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:36,807 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:36,807 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000002
2015-02-12 14:44:36,807 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:36,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,808 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0007
2015-02-12 14:44:36,808 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,808 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:36,808 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0007, with delay of 10800 seconds
2015-02-12 14:44:36,809 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,809 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,851 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088
2015-02-12 14:44:36,852 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084
2015-02-12 14:44:36,852 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082
2015-02-12 14:44:36,853 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090
2015-02-12 14:44:36,854 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086
2015-02-12 14:44:36,871 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:44:36,871 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:36,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,872 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:36,872 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000003
2015-02-12 14:44:36,872 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0007
2015-02-12 14:44:36,872 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:44:36,872 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0007, with delay of 10800 seconds
2015-02-12 14:44:36,872 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,873 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,873 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0007
2015-02-12 14:44:36,872 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:36,895 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088
2015-02-12 14:44:36,895 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083
2015-02-12 14:44:36,896 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089
2015-02-12 14:44:36,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087
2015-02-12 14:44:37,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741910_1086
2015-02-12 14:44:37,180 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087
2015-02-12 14:44:37,254 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087
2015-02-12 14:44:37,257 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085
2015-02-12 14:44:37,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089
2015-02-12 14:44:37,382 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741906_1082
2015-02-12 14:44:37,383 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741909_1085
2015-02-12 14:44:37,384 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741907_1083
2015-02-12 14:44:37,384 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741908_1084
2015-02-12 14:44:37,384 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088
2015-02-12 14:44:37,385 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741913_1089
2015-02-12 14:44:37,385 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090
2015-02-12 14:44:37,446 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:37,446 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000004
2015-02-12 14:44:37,447 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741905 for deletion
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741902 for deletion
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741903 for deletion
2015-02-12 14:44:37,499 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741905
2015-02-12 14:44:37,500 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 14:44:37,500 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 14:44:37,501 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 14:44:37,501 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741903
2015-02-12 14:44:37,502 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741902
2015-02-12 14:44:37,671 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:37,671 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000005
2015-02-12 14:44:37,671 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:44:37,722 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0008_01_000002
2015-02-12 14:44:37,723 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:37,723 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0008_01_000003
2015-02-12 14:44:37,723 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:37,723 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0008_01_000004
2015-02-12 14:44:37,724 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:37,724 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0008_01_000005
2015-02-12 14:44:37,724 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:37,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:37,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:37,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,809 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:37,809 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000006
2015-02-12 14:44:37,809 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:44:37,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:37,877 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:37,918 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:37,918 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:37,918 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:37,920 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:37,923 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000003 by user soberoi
2015-02-12 14:44:37,924 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0008
2015-02-12 14:44:37,923 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000002 by user soberoi
2015-02-12 14:44:37,925 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from NEW to INITING
2015-02-12 14:44:37,925 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000003 to application application_1423780884992_0008
2015-02-12 14:44:37,925 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from INITING to RUNNING
2015-02-12 14:44:37,924 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000003
2015-02-12 14:44:37,926 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:44:37,926 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,926 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,926 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:37,926 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0008
2015-02-12 14:44:37,927 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:37,927 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:37,927 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0008_01_000003
2015-02-12 14:44:37,925 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000004 by user soberoi
2015-02-12 14:44:37,928 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0008
2015-02-12 14:44:37,928 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000004
2015-02-12 14:44:37,925 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0008
2015-02-12 14:44:37,929 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000002
2015-02-12 14:44:37,929 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from NEW to INITING
2015-02-12 14:44:37,929 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000004 to application application_1423780884992_0008
2015-02-12 14:44:37,930 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from INITING to RUNNING
2015-02-12 14:44:37,930 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:44:37,930 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,930 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,930 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:37,930 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0008
2015-02-12 14:44:37,930 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:37,930 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:37,931 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0008_01_000004
2015-02-12 14:44:37,931 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from NEW to INITING
2015-02-12 14:44:37,931 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000002 to application application_1423780884992_0008
2015-02-12 14:44:37,932 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from INITING to RUNNING
2015-02-12 14:44:37,932 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:44:37,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,932 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:37,932 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0008
2015-02-12 14:44:37,932 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:37,932 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:37,933 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0008_01_000002
2015-02-12 14:44:37,951 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000005 by user soberoi
2015-02-12 14:44:37,952 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000005
2015-02-12 14:44:37,952 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000005 to application application_1423780884992_0008
2015-02-12 14:44:37,952 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:44:37,952 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,953 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0008
2015-02-12 14:44:37,953 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:37,953 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0008
2015-02-12 14:44:37,953 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:37,961 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0008_01_000003.tokens. Credentials list:
2015-02-12 14:44:37,961 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0008_01_000002.tokens. Credentials list:
2015-02-12 14:44:37,963 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0008_01_000004.tokens. Credentials list:
2015-02-12 14:44:38,018 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:38,019 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:38,143 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 14:44:38,143 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741905 for deletion
2015-02-12 14:44:38,143 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741896 for deletion
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741905
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900 for deletion
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901 for deletion
2015-02-12 14:44:38,144 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741896
2015-02-12 14:44:38,145 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741901_1077 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741901
2015-02-12 14:44:38,145 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741900
2015-02-12 14:44:38,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:38,203 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:38,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:38,266 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000005/default_container_executor.sh]
2015-02-12 14:44:38,397 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0008_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000002.tokens
2015-02-12 14:44:38,397 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:44:38,409 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000004.tokens
2015-02-12 14:44:38,410 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:44:38,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0008_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000003.tokens
2015-02-12 14:44:38,412 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:44:38,449 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:38,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:38,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:38,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:38,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:38,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:38,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:38,638 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:38,671 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:38,671 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:38,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:38,681 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:38,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:38,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:38,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:38,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:38,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:38,740 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:38,750 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:38,753 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000006 by user soberoi
2015-02-12 14:44:38,753 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000006
2015-02-12 14:44:38,753 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000006 to application application_1423780884992_0008
2015-02-12 14:44:38,754 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:44:38,754 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:38,754 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0008
2015-02-12 14:44:38,754 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:38,754 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0008
2015-02-12 14:44:38,755 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0008_01_000006
2015-02-12 14:44:38,767 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0008/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:38,767 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:38,768 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:38,791 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0008_01_000006.tokens. Credentials list:
2015-02-12 14:44:38,807 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0008/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:38,807 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:38,810 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:38,810 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:38,810 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:38,811 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000007
2015-02-12 14:44:38,811 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:44:38,820 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0008/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:38,820 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:38,852 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:38,852 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:38,864 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:38,864 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:38,878 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:38,893 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:38,894 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:38,918 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:38,918 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:39,128 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000002/default_container_executor.sh]
2015-02-12 14:44:39,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000006/default_container_executor.sh]
2015-02-12 14:44:39,146 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000004/default_container_executor.sh]
2015-02-12 14:44:39,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000003/default_container_executor.sh]
2015-02-12 14:44:39,532 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30006 milliseconds
2015-02-12 14:44:39,532 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:44:39,744 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:44:39,745 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:39,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:39,963 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0008_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000006.tokens
2015-02-12 14:44:39,963 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:44:40,751 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:44:40,751 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:44:40,751 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000007
2015-02-12 14:44:40,751 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:44:40,751 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000007 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:44:40,814 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0008_01_000007
2015-02-12 14:44:41,324 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741912_1088
2015-02-12 14:44:41,326 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741911_1087
2015-02-12 14:44:41,529 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091
2015-02-12 14:44:41,530 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741914_1090
2015-02-12 14:44:42,107 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091
2015-02-12 14:44:42,107 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092
2015-02-12 14:44:42,262 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092
2015-02-12 14:44:42,392 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741916_1092
2015-02-12 14:44:42,393 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741915_1091
2015-02-12 14:44:47,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:47,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:47,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:47,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:47,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:47,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:48,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:48,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:48,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.20.txt dst=null perm=null proto=rpc
2015-02-12 14:44:48,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:48,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:44:48,575 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:48,577 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000005
2015-02-12 14:44:48,577 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:44:48,577 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000005
2015-02-12 14:44:48,577 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000005
2015-02-12 14:44:48,608 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0008_01_000005 is : 143
2015-02-12 14:44:48,611 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:44:48,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093 src: /127.0.0.1:51504 dest: /127.0.0.1:50546
2015-02-12 14:44:48,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093 src: /127.0.0.1:51505 dest: /127.0.0.1:50539
2015-02-12 14:44:48,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093 src: /127.0.0.1:51506 dest: /127.0.0.1:50543
2015-02-12 14:44:48,633 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist for DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:48,635 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:48,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000005
2015-02-12 14:44:48,637 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000005
2015-02-12 14:44:48,640 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000005
2015-02-12 14:44:48,642 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000005
2015-02-12 14:44:48,643 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000005
2015-02-12 14:44:48,646 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:48,647 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000005 from application application_1423780884992_0008
2015-02-12 14:44:48,648 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:48,648 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:44:48,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:48,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:44:48,837 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:48,839 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000002
2015-02-12 14:44:48,839 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000002
2015-02-12 14:44:48,839 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:44:48,839 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000002
2015-02-12 14:44:48,869 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0008_01_000002 is : 143
2015-02-12 14:44:48,879 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:48,880 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000002
2015-02-12 14:44:48,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000002
2015-02-12 14:44:48,885 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000002
2015-02-12 14:44:48,887 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000002
2015-02-12 14:44:48,887 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000002
2015-02-12 14:44:48,887 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:48,888 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000002 from application application_1423780884992_0008
2015-02-12 14:44:48,888 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:48,888 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:44:48,913 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:48,914 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000004
2015-02-12 14:44:48,915 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000004
2015-02-12 14:44:48,915 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:44:48,915 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000004
2015-02-12 14:44:48,933 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0008_01_000004 is : 143
2015-02-12 14:44:48,946 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:48,947 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000004
2015-02-12 14:44:48,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000004
2015-02-12 14:44:48,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000004
2015-02-12 14:44:48,949 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000004
2015-02-12 14:44:48,949 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:48,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000004
2015-02-12 14:44:48,950 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000004 from application application_1423780884992_0008
2015-02-12 14:44:48,950 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:48,951 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:44:49,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:44:49,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:44:49,090 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:49,092 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000003
2015-02-12 14:44:49,092 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000003
2015-02-12 14:44:49,093 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:44:49,093 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000003
2015-02-12 14:44:49,115 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0008_01_000003 is : 143
2015-02-12 14:44:49,123 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:49,123 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000003
2015-02-12 14:44:49,123 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000003
2015-02-12 14:44:49,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000003
2015-02-12 14:44:49,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000003
2015-02-12 14:44:49,124 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000003
2015-02-12 14:44:49,124 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:49,124 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000003 from application application_1423780884992_0008
2015-02-12 14:44:49,124 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:49,124 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:44:49,136 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:49,138 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000006
2015-02-12 14:44:49,138 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000006
2015-02-12 14:44:49,139 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:44:49,139 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000006
2015-02-12 14:44:49,140 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:49,141 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:44:49,141 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000002
2015-02-12 14:44:49,141 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:44:49,141 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000002 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:44:49,159 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0008_01_000006 is : 143
2015-02-12 14:44:49,174 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:49,175 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000006
2015-02-12 14:44:49,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000006
2015-02-12 14:44:49,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000006
2015-02-12 14:44:49,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000006
2015-02-12 14:44:49,180 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000006
2015-02-12 14:44:49,182 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:49,182 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000006 from application application_1423780884992_0008
2015-02-12 14:44:49,184 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:49,184 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:44:49,580 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:49,580 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:44:49,581 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000005
2015-02-12 14:44:49,581 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:44:49,581 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000005 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:44:49,921 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:49,922 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:44:49,922 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000004
2015-02-12 14:44:49,922 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:49,922 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:49,923 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:49,923 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000008
2015-02-12 14:44:49,923 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0008_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:44:50,094 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:50,095 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:44:50,095 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000003
2015-02-12 14:44:50,095 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:50,095 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:50,144 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:50,145 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:50,145 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:44:50,145 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000006
2015-02-12 14:44:50,145 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:50,145 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000006 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:50,583 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:50,811 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:50,821 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:50,823 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0008_01_000008 by user soberoi
2015-02-12 14:44:50,823 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000008
2015-02-12 14:44:50,823 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0008_01_000008 to application application_1423780884992_0008
2015-02-12 14:44:50,824 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:44:50,824 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0008
2015-02-12 14:44:50,824 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0008
2015-02-12 14:44:50,824 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:44:50,824 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0008
2015-02-12 14:44:50,825 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:50,858 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:50,858 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:50,922 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:50,922 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:50,964 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000008/default_container_executor.sh]
2015-02-12 14:44:51,096 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:51,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0008_01_000002]
2015-02-12 14:44:51,147 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:51,148 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:51,586 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0008_01_000005]
2015-02-12 14:44:51,586 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:51,820 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:44:51,922 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0008_01_000004]
2015-02-12 14:44:51,922 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:52,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0008_01_000003]
2015-02-12 14:44:52,103 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:52,150 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0008_01_000006]
2015-02-12 14:44:52,151 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:53,453 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:53,457 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:53,459 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:53,461 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:53,468 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:44:53,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:53,748 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:44:53,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094 src: /127.0.0.1:51520 dest: /127.0.0.1:50549
2015-02-12 14:44:53,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094 src: /127.0.0.1:51521 dest: /127.0.0.1:50539
2015-02-12 14:44:53,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094 src: /127.0.0.1:51522 dest: /127.0.0.1:50543
2015-02-12 14:44:53,890 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51522, dest: /127.0.0.1:50543, bytes: 292, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0008_r_000000_0_1609913170_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094, duration: 37883000
2015-02-12 14:44:53,890 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:53,891 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51521, dest: /127.0.0.1:50539, bytes: 292, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0008_r_000000_0_1609913170_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094, duration: 38750000
2015-02-12 14:44:53,891 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:53,891 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:53,894 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:53,892 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51520, dest: /127.0.0.1:50549, bytes: 292, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0008_r_000000_0_1609913170_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094, duration: 40096000
2015-02-12 14:44:53,894 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:53,896 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:53,900 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0008_r_000000_0_1609913170_1
2015-02-12 14:44:53,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:53,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:44:53,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/task_1423780884992_0008_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:44:53,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/_temporary/attempt_1423780884992_0008_r_000000_0 dst=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/task_1423780884992_0008_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:44:53,946 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:44:53,949 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000008
2015-02-12 14:44:53,949 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000008
2015-02-12 14:44:53,949 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:44:53,949 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000008
2015-02-12 14:44:53,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:53,967 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:53,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:44:53,985 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0008_01_000008 is : 143
2015-02-12 14:44:53,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:53,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:53,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/task_1423780884992_0008_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:44:54,004 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:44:54,005 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000008
2015-02-12 14:44:54,005 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:44:54,005 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000008 from application application_1423780884992_0008
2015-02-12 14:44:54,005 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:54,005 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:44:54,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:44:54,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000008
2015-02-12 14:44:54,013 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000008
2015-02-12 14:44:54,013 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000008
2015-02-12 14:44:54,013 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000008
2015-02-12 14:44:54,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary/1/task_1423780884992_0008_r_000000/part-00000 dst=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:54,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_temporary dst=null perm=null proto=rpc
2015-02-12 14:44:54,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:54,038 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:54,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:54,046 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:54,066 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51506, dest: /127.0.0.1:50543, bytes: 69156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093, duration: 5443844000
2015-02-12 14:44:54,066 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:54,067 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16340
2015-02-12 14:44:54,068 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51505, dest: /127.0.0.1:50539, bytes: 69156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093, duration: 5444666000
2015-02-12 14:44:54,069 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,072 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51504, dest: /127.0.0.1:50546, bytes: 69156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093, duration: 5450393000
2015-02-12 14:44:54,073 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,074 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16340
2015-02-12 14:44:54,077 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:54,077 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741917_1093 size 69156
2015-02-12 14:44:54,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:54,082 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:44:54,085 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095 src: /127.0.0.1:51524 dest: /127.0.0.1:50549
2015-02-12 14:44:54,087 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095 src: /127.0.0.1:51525 dest: /127.0.0.1:50543
2015-02-12 14:44:54,090 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095 src: /127.0.0.1:51526 dest: /127.0.0.1:50539
2015-02-12 14:44:54,094 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51526, dest: /127.0.0.1:50539, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095, duration: 1989000
2015-02-12 14:44:54,094 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:54,095 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:44:54,095 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51525, dest: /127.0.0.1:50543, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095, duration: 3378000
2015-02-12 14:44:54,096 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,100 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51524, dest: /127.0.0.1:50549, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095, duration: 6560000
2015-02-12 14:44:54,100 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,102 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:54,104 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:54,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741919_1095 size 425
2015-02-12 14:44:54,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:54,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:54,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:54,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:54,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:54,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:44:54,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:54,146 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:44:54,149 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096 src: /127.0.0.1:51528 dest: /127.0.0.1:50549
2015-02-12 14:44:54,152 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096 src: /127.0.0.1:51529 dest: /127.0.0.1:50539
2015-02-12 14:44:54,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096 src: /127.0.0.1:51530 dest: /127.0.0.1:50543
2015-02-12 14:44:54,160 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51530, dest: /127.0.0.1:50543, bytes: 69156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096, duration: 3241000
2015-02-12 14:44:54,161 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:54,165 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51529, dest: /127.0.0.1:50539, bytes: 69156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096, duration: 6894000
2015-02-12 14:44:54,166 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,167 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51528, dest: /127.0.0.1:50549, bytes: 69156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096, duration: 9373000
2015-02-12 14:44:54,167 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,169 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:44:54,170 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:44:54,172 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:44:54,180 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:54,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:54,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:54,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:54,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:54,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:44:54,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008/job_1423780884992_0008_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:44:54,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:54,205 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:44:54,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097 src: /127.0.0.1:51532 dest: /127.0.0.1:50546
2015-02-12 14:44:54,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097 src: /127.0.0.1:51533 dest: /127.0.0.1:50539
2015-02-12 14:44:54,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097 src: /127.0.0.1:51534 dest: /127.0.0.1:50549
2015-02-12 14:44:54,218 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51534, dest: /127.0.0.1:50549, bytes: 114079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097, duration: 2736000
2015-02-12 14:44:54,218 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:54,218 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:54,218 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51533, dest: /127.0.0.1:50539, bytes: 114079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097, duration: 3298000
2015-02-12 14:44:54,219 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:54,220 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51532, dest: /127.0.0.1:50546, bytes: 114079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-495876380_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097, duration: 4738000
2015-02-12 14:44:54,220 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:54,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:54,222 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-495876380_1
2015-02-12 14:44:54,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:54,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:54,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:54,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:44:54,238 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0008_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:44:54,238 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:44:54,238 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0008 with final state: FINISHING
2015-02-12 14:44:54,238 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from RUNNING to FINAL_SAVING
2015-02-12 14:44:54,238 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:44:54,239 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0008
2015-02-12 14:44:54,239 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from FINAL_SAVING to FINISHING
2015-02-12 14:44:54,956 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:44:54,956 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:44:54,956 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000008
2015-02-12 14:44:54,956 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:44:54,956 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000008 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:44:55,244 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0008 unregistered successfully.
2015-02-12 14:44:55,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741911_1087 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:44:55,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741912_1088 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:44:55,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741913_1089 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:44:55,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:44:55,250 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741916_1092 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:44:55,250 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741917_1093 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:44:55,250 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:44:55,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0008 dst=null perm=null proto=rpc
2015-02-12 14:44:55,310 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] starting step: (1/2) ...tform/cogroupacogroupopt1
2015-02-12 14:44:55,324 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:44:55,338 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:44:55,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:44:55,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:55,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:55,347 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 9
2015-02-12 14:44:55,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009 dst=null perm=null proto=rpc
2015-02-12 14:44:55,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:44:55,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:44:55,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,356 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:44:55,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 src: /127.0.0.1:51537 dest: /127.0.0.1:50543
2015-02-12 14:44:55,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 src: /127.0.0.1:51538 dest: /127.0.0.1:50546
2015-02-12 14:44:55,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 src: /127.0.0.1:51539 dest: /127.0.0.1:50539
2015-02-12 14:44:55,366 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51539, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098, duration: 2687000
2015-02-12 14:44:55,366 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:55,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:44:55,367 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51538, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098, duration: 3569000
2015-02-12 14:44:55,367 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,367 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,368 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51537, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098, duration: 4589000
2015-02-12 14:44:55,368 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,369 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,370 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:55,372 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar
2015-02-12 14:44:55,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:44:55,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:44:55,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:55,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:44:55,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:44:55,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:55,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:55,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:55,397 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:55,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:55,399 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:55,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:55,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:55,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:55,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:44:55,405 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:55,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:55,407 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:44:55,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:44:55,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,416 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split
2015-02-12 14:44:55,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:55,418 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:44:55,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099 src: /127.0.0.1:51540 dest: /127.0.0.1:50549
2015-02-12 14:44:55,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099 src: /127.0.0.1:51541 dest: /127.0.0.1:50546
2015-02-12 14:44:55,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099 src: /127.0.0.1:51542 dest: /127.0.0.1:50539
2015-02-12 14:44:55,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099 src: /127.0.0.1:51543 dest: /127.0.0.1:50543
2015-02-12 14:44:55,430 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51543, dest: /127.0.0.1:50543, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, duration: 3637000
2015-02-12 14:44:55,430 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:55,431 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,431 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51542, dest: /127.0.0.1:50539, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, duration: 4251000
2015-02-12 14:44:55,431 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,432 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,432 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51541, dest: /127.0.0.1:50546, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, duration: 5523000
2015-02-12 14:44:55,432 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,434 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51540, dest: /127.0.0.1:50549, bytes: 1797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, duration: 7260000
2015-02-12 14:44:55,434 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,434 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,437 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,439 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:55,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,447 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:44:55,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100 src: /127.0.0.1:51544 dest: /127.0.0.1:50543
2015-02-12 14:44:55,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100 src: /127.0.0.1:51545 dest: /127.0.0.1:50546
2015-02-12 14:44:55,454 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100 src: /127.0.0.1:51546 dest: /127.0.0.1:50539
2015-02-12 14:44:55,458 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51546, dest: /127.0.0.1:50539, bytes: 185, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100, duration: 1703000
2015-02-12 14:44:55,458 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:55,458 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,459 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51545, dest: /127.0.0.1:50546, bytes: 185, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100, duration: 1848000
2015-02-12 14:44:55,459 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,460 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51544, dest: /127.0.0.1:50543, bytes: 185, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100, duration: 3056000
2015-02-12 14:44:55,460 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,462 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,463 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,464 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:55,464 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:44:55,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:44:55,493 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:44:55,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101 src: /127.0.0.1:51547 dest: /127.0.0.1:50549
2015-02-12 14:44:55,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101 src: /127.0.0.1:51548 dest: /127.0.0.1:50543
2015-02-12 14:44:55,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101 src: /127.0.0.1:51549 dest: /127.0.0.1:50546
2015-02-12 14:44:55,506 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51549, dest: /127.0.0.1:50546, bytes: 98075, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101, duration: 2096000
2015-02-12 14:44:55,506 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:44:55,506 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,507 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51548, dest: /127.0.0.1:50543, bytes: 98075, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101, duration: 2955000
2015-02-12 14:44:55,507 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,508 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,508 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51547, dest: /127.0.0.1:50549, bytes: 98075, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101, duration: 4028000
2015-02-12 14:44:55,508 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:44:55,512 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:44:55,515 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:44:55,516 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0009
2015-02-12 14:44:55,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009 dst=null perm=null proto=rpc
2015-02-12 14:44:55,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:55,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:55,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:55,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:55,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:55,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:55,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,543 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 9 submitted by user soberoi
2015-02-12 14:44:55,543 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0009
2015-02-12 14:44:55,543 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0009
2015-02-12 14:44:55,544 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0009
2015-02-12 14:44:55,544 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from NEW to NEW_SAVING
2015-02-12 14:44:55,544 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:44:55,544 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0009 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:44:55,545 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from SUBMITTED to ACCEPTED
2015-02-12 14:44:55,545 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0009_000001
2015-02-12 14:44:55,545 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from NEW to SUBMITTED
2015-02-12 14:44:55,545 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0009_000001 to scheduler from user: soberoi
2015-02-12 14:44:55,545 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:44:55,546 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0009
2015-02-12 14:44:55,552 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0009/
2015-02-12 14:44:55,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] submitted hadoop job: job_1423780884992_0009
2015-02-12 14:44:55,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogroupopt] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0009/
2015-02-12 14:44:55,605 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:44:55,605 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000001
2015-02-12 14:44:55,605 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:44:55,605 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0009_01_000001
2015-02-12 14:44:55,606 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:44:55,606 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0009_000001
2015-02-12 14:44:55,606 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0009 AttemptId: appattempt_1423780884992_0009_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0009_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:44:55,606 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:44:55,607 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:44:55,607 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0009_000001
2015-02-12 14:44:55,611 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0009_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0009_000001
2015-02-12 14:44:55,611 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:44:55,611 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0009_000001
2015-02-12 14:44:55,612 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0009_000001
2015-02-12 14:44:55,614 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:44:55,616 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000001 by user soberoi
2015-02-12 14:44:55,616 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0009
2015-02-12 14:44:55,617 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000001
2015-02-12 14:44:55,617 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from NEW to INITING
2015-02-12 14:44:55,617 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000001 to application application_1423780884992_0009
2015-02-12 14:44:55,617 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from INITING to RUNNING
2015-02-12 14:44:55,617 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0009_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0009_000001
2015-02-12 14:44:55,617 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:44:55,617 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:44:55,618 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:44:55,618 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:44:55,618 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:44:55,618 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:44:55,618 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:44:55,619 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0009_01_000001
2015-02-12 14:44:55,629 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0009_01_000001.tokens. Credentials list:
2015-02-12 14:44:55,737 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:44:55,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000001.tokens
2015-02-12 14:44:55,845 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:44:55,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:44:55,959 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:55,974 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:55,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:55,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:56,041 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0009/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:56,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:56,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:44:56,106 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:56,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:56,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:44:56,171 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0009/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:44:56,171 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:44:56,210 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:44:56,210 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:44:56,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000001/default_container_executor.sh]
2015-02-12 14:44:56,605 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:44:56,964 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:57,665 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073741922_1098 to datanode(s) 127.0.0.1:50549
2015-02-12 14:44:57,666 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741911_1087, blk_1073741912_1088, blk_1073741914_1090, blk_1073741915_1091, blk_1073741917_1093]
2015-02-12 14:44:57,666 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741911_1087, blk_1073741912_1088, blk_1073741913_1089, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-02-12 14:44:57,968 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:58,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:44:58,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:44:58,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:44:58,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:44:58,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009 dst=null perm=null proto=rpc
2015-02-12 14:44:58,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:44:58,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:44:58,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 14:44:58,521 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 to 127.0.0.1:50549
2015-02-12 14:44:58,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 14:44:58,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 14:44:58,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 14:44:58,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741915 for deletion
2015-02-12 14:44:58,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741917 for deletion
2015-02-12 14:44:58,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 14:44:58,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741917
2015-02-12 14:44:58,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 14:44:58,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741915
2015-02-12 14:44:58,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 src: /127.0.0.1:51557 dest: /127.0.0.1:50549
2015-02-12 14:44:58,523 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:44:58,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098 src: /127.0.0.1:51557 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:44:58,525 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741922_1098 size 254067
2015-02-12 14:44:58,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:58,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741915 for deletion
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741916 for deletion
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 14:44:58,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 14:44:58,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741916
2015-02-12 14:44:58,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741917 for deletion
2015-02-12 14:44:58,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 14:44:58,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741915
2015-02-12 14:44:58,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741917
2015-02-12 14:44:58,969 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:59,538 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:44:59,540 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0009_000001
2015-02-12 14:44:59,541 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0009 APPATTEMPTID=appattempt_1423780884992_0009_000001
2015-02-12 14:44:59,541 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:44:59,541 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from ACCEPTED to RUNNING
2015-02-12 14:44:59,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:59,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:44:59,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:44:59,971 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:44:59,975 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:45:00,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102 src: /127.0.0.1:51564 dest: /127.0.0.1:50543
2015-02-12 14:45:00,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102 src: /127.0.0.1:51565 dest: /127.0.0.1:50549
2015-02-12 14:45:00,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102 src: /127.0.0.1:51566 dest: /127.0.0.1:50539
2015-02-12 14:45:00,074 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51566, dest: /127.0.0.1:50539, bytes: 114790, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102, duration: 36469000
2015-02-12 14:45:00,075 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:00,075 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:45:00,076 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51565, dest: /127.0.0.1:50549, bytes: 114790, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102, duration: 37669000
2015-02-12 14:45:00,076 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:00,077 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51564, dest: /127.0.0.1:50543, bytes: 114790, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102, duration: 38882000
2015-02-12 14:45:00,077 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:00,078 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:45:00,079 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:00,093 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:00,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:00,133 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:00,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103 src: /127.0.0.1:51567 dest: /127.0.0.1:50543
2015-02-12 14:45:00,137 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103 src: /127.0.0.1:51568 dest: /127.0.0.1:50549
2015-02-12 14:45:00,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103 src: /127.0.0.1:51569 dest: /127.0.0.1:50546
2015-02-12 14:45:00,145 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51569, dest: /127.0.0.1:50546, bytes: 394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103, duration: 4598000
2015-02-12 14:45:00,146 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:00,146 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:00,147 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51568, dest: /127.0.0.1:50549, bytes: 394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103, duration: 5201000
2015-02-12 14:45:00,147 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:00,148 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51567, dest: /127.0.0.1:50543, bytes: 394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103, duration: 6968000
2015-02-12 14:45:00,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:00,148 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:00,149 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:00,151 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009.summary is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:00,391 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0008_01_000001 succeeded
2015-02-12 14:45:00,391 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:45:00,391 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0008_01_000001
2015-02-12 14:45:00,405 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000001
2015-02-12 14:45:00,405 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000001
2015-02-12 14:45:00,406 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000001
2015-02-12 14:45:00,406 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0008/container_1423780884992_0008_01_000001
2015-02-12 14:45:00,406 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000001
2015-02-12 14:45:00,407 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0008_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:45:00,407 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0008_01_000001 from application application_1423780884992_0008
2015-02-12 14:45:00,407 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:00,407 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0008
2015-02-12 14:45:00,612 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0008_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:00,612 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0008_000001
2015-02-12 14:45:00,612 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0008_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:45:00,613 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000001
2015-02-12 14:45:00,613 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:45:00,613 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0008_000001 released container container_1423780884992_0008_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:45:00,613 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0008_000001
2015-02-12 14:45:00,614 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0008_000001 State change from FINISHING to FINISHED
2015-02-12 14:45:00,614 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:00,614 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000002
2015-02-12 14:45:00,614 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:45:00,614 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0008 State change from FINISHING to FINISHED
2015-02-12 14:45:00,615 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0008
2015-02-12 14:45:00,615 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0008_000001 is done. finalState=FINISHED
2015-02-12 14:45:00,615 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0008,name=[3E9AC9D77F2F4953978740D284E1A487/DA0D6E8276F543D1BB6DE60F7B78917C] cogroupopt/(2/2),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0008/jobhistory/job/job_1423780884992_0008,appMasterHost=10.1.1.67,startTime=1423781071493,finishTime=1423781094238,finalStatus=SUCCEEDED
2015-02-12 14:45:00,615 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0008_000001
2015-02-12 14:45:00,615 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0008 requests cleared
2015-02-12 14:45:00,618 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0008_000001 (auth:SIMPLE)
2015-02-12 14:45:00,620 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0008_01_000001
2015-02-12 14:45:00,620 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0008 CONTAINERID=container_1423780884992_0008_01_000001
2015-02-12 14:45:00,621 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0008_01_000001]
2015-02-12 14:45:00,621 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:00,621 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:00,621 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:00,621 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000003
2015-02-12 14:45:00,622 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:45:00,622 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,622 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,623 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0008
2015-02-12 14:45:00,623 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:00,623 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0008, with delay of 10800 seconds
2015-02-12 14:45:00,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,669 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741911_1087, blk_1073741912_1088, blk_1073741913_1089, blk_1073741914_1090, blk_1073741916_1092, blk_1073741917_1093]
2015-02-12 14:45:00,670 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741911_1087, blk_1073741912_1088, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092]
2015-02-12 14:45:00,976 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:00,976 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:00,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,977 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:00,977 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000004
2015-02-12 14:45:00,977 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0008
2015-02-12 14:45:00,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,977 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:00,978 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:00,977 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:00,979 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0008, with delay of 10800 seconds
2015-02-12 14:45:00,978 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,131 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:01,132 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:01,132 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000005
2015-02-12 14:45:01,132 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:01,132 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,133 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,133 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0008
2015-02-12 14:45:01,133 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:01,134 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0008, with delay of 10800 seconds
2015-02-12 14:45:01,133 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,176 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:01,176 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:01,176 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000006
2015-02-12 14:45:01,176 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:01,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,177 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0008
2015-02-12 14:45:01,177 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:01,177 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0008, with delay of 10800 seconds
2015-02-12 14:45:01,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0008
2015-02-12 14:45:01,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 14:45:01,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 14:45:01,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 14:45:01,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 14:45:01,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 14:45:01,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 14:45:01,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 14:45:01,524 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 14:45:01,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741916 for deletion
2015-02-12 14:45:01,524 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741917 for deletion
2015-02-12 14:45:01,525 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741916
2015-02-12 14:45:01,525 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741917
2015-02-12 14:45:01,543 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094
2015-02-12 14:45:01,545 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098
2015-02-12 14:45:01,592 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0009_01_000002
2015-02-12 14:45:01,592 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:01,592 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:01,593 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0009_01_000004
2015-02-12 14:45:01,593 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:01,593 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0009_01_000005
2015-02-12 14:45:01,594 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:01,594 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0009_01_000006
2015-02-12 14:45:01,594 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:01,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:01,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:01,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:01,743 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:01,743 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:01,744 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:01,744 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:01,744 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:01,747 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101
2015-02-12 14:45:01,748 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000003 by user soberoi
2015-02-12 14:45:01,748 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095
2015-02-12 14:45:01,748 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000004 by user soberoi
2015-02-12 14:45:01,748 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000003 to application application_1423780884992_0009
2015-02-12 14:45:01,748 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0009
2015-02-12 14:45:01,749 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:45:01,749 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,749 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,749 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from NEW to INITING
2015-02-12 14:45:01,748 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000003
2015-02-12 14:45:01,749 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000004 to application application_1423780884992_0009
2015-02-12 14:45:01,749 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:01,750 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0009
2015-02-12 14:45:01,749 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000004
2015-02-12 14:45:01,751 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:01,748 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099
2015-02-12 14:45:01,751 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000005 by user soberoi
2015-02-12 14:45:01,751 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0009
2015-02-12 14:45:01,752 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000005
2015-02-12 14:45:01,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100
2015-02-12 14:45:01,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096
2015-02-12 14:45:01,754 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000006 by user soberoi
2015-02-12 14:45:01,754 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0009
2015-02-12 14:45:01,750 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from INITING to RUNNING
2015-02-12 14:45:01,754 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:45:01,754 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,755 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,755 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:01,755 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0009
2015-02-12 14:45:01,755 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:01,755 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:01,755 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0009_01_000004
2015-02-12 14:45:01,755 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from NEW to INITING
2015-02-12 14:45:01,755 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000005 to application application_1423780884992_0009
2015-02-12 14:45:01,756 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from INITING to RUNNING
2015-02-12 14:45:01,756 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000002 by user soberoi
2015-02-12 14:45:01,756 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:45:01,756 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,756 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000002
2015-02-12 14:45:01,756 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from NEW to INITING
2015-02-12 14:45:01,757 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000006 to application application_1423780884992_0009
2015-02-12 14:45:01,757 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from INITING to RUNNING
2015-02-12 14:45:01,758 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:45:01,758 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,758 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,758 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:01,759 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0009
2015-02-12 14:45:01,759 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:01,754 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000006
2015-02-12 14:45:01,759 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000002 to application application_1423780884992_0009
2015-02-12 14:45:01,760 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:45:01,760 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,760 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,760 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:01,760 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0009
2015-02-12 14:45:01,759 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:01,761 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0009_01_000006
2015-02-12 14:45:01,761 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:01,756 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0009
2015-02-12 14:45:01,761 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:01,762 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0009
2015-02-12 14:45:01,762 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:01,762 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:01,762 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0009_01_000005
2015-02-12 14:45:01,791 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0009_01_000004.tokens. Credentials list:
2015-02-12 14:45:01,806 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0009_01_000005.tokens. Credentials list:
2015-02-12 14:45:01,807 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0009_01_000006.tokens. Credentials list:
2015-02-12 14:45:01,834 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:01,836 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:01,843 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:01,843 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:01,980 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:01,980 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:02,071 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:02,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:02,083 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:02,120 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097
2015-02-12 14:45:02,135 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:02,163 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911 for deletion
2015-02-12 14:45:02,163 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912 for deletion
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741911_1087 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741911
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741915 for deletion
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741916 for deletion
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741912_1088 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741912
2015-02-12 14:45:02,164 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 14:45:02,165 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 14:45:02,165 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741915
2015-02-12 14:45:02,165 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741916
2015-02-12 14:45:02,177 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:02,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000003/default_container_executor.sh]
2015-02-12 14:45:02,190 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000002/default_container_executor.sh]
2015-02-12 14:45:02,282 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097
2015-02-12 14:45:02,282 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099
2015-02-12 14:45:02,283 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096
2015-02-12 14:45:02,284 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094
2015-02-12 14:45:02,284 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100
2015-02-12 14:45:02,285 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095
2015-02-12 14:45:02,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101
2015-02-12 14:45:02,352 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0009_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000006.tokens
2015-02-12 14:45:02,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:02,352 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000005.tokens
2015-02-12 14:45:02,354 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:02,366 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000004.tokens
2015-02-12 14:45:02,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:02,409 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741920_1096
2015-02-12 14:45:02,410 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741919_1095
2015-02-12 14:45:02,410 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741918_1094
2015-02-12 14:45:02,411 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741921_1097
2015-02-12 14:45:02,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741925_1101
2015-02-12 14:45:02,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099
2015-02-12 14:45:02,486 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098
2015-02-12 14:45:02,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:02,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:02,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098
2015-02-12 14:45:02,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741923_1099
2015-02-12 14:45:02,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741924_1100
2015-02-12 14:45:02,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:02,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:02,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:02,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:02,594 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:02,603 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:02,607 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:45:02,616 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:02,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:02,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:02,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:02,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:02,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:02,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:02,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:02,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:02,700 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:02,700 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:02,716 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:02,716 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:02,735 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:02,735 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:02,765 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:02,766 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:02,783 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:02,783 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:02,790 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:02,790 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:02,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000006/default_container_executor.sh]
2015-02-12 14:45:03,003 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000004/default_container_executor.sh]
2015-02-12 14:45:03,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000005/default_container_executor.sh]
2015-02-12 14:45:06,758 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102
2015-02-12 14:45:06,759 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103
2015-02-12 14:45:07,418 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102
2015-02-12 14:45:07,419 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103
2015-02-12 14:45:07,490 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741926_1102
2015-02-12 14:45:07,524 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741927_1103
2015-02-12 14:45:07,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741922_1098
2015-02-12 14:45:09,538 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30006 milliseconds
2015-02-12 14:45:09,538 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:45:11,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:11,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:11,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:11,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:11,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:11,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:45:11,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:11,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:11,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:45:11,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:45:11,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/nums.10.txt dst=null perm=null proto=rpc
2015-02-12 14:45:12,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:45:12,215 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:12,216 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000003
2015-02-12 14:45:12,217 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000003
2015-02-12 14:45:12,217 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:45:12,217 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000003
2015-02-12 14:45:12,242 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0009_01_000003 is : 143
2015-02-12 14:45:12,244 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:12,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104 src: /127.0.0.1:51619 dest: /127.0.0.1:50539
2015-02-12 14:45:12,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104 src: /127.0.0.1:51620 dest: /127.0.0.1:50549
2015-02-12 14:45:12,251 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:12,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104 src: /127.0.0.1:51621 dest: /127.0.0.1:50546
2015-02-12 14:45:12,254 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000003
2015-02-12 14:45:12,254 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000003
2015-02-12 14:45:12,254 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:12,254 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000003 from application application_1423780884992_0009
2015-02-12 14:45:12,254 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:12,254 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:12,254 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000003
2015-02-12 14:45:12,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000003
2015-02-12 14:45:12,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000003
2015-02-12 14:45:12,264 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist for DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:12,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:45:12,382 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:12,384 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000002
2015-02-12 14:45:12,384 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000002
2015-02-12 14:45:12,385 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:45:12,385 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000002
2015-02-12 14:45:12,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:12,386 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:45:12,386 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000003
2015-02-12 14:45:12,386 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:45:12,386 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000003 on node: host: 10.1.1.67:50575 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:45:12,404 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0009_01_000002 is : 143
2015-02-12 14:45:12,417 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:12,418 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000002
2015-02-12 14:45:12,418 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000002
2015-02-12 14:45:12,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000002
2015-02-12 14:45:12,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000002
2015-02-12 14:45:12,420 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000002
2015-02-12 14:45:12,421 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:12,421 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000002 from application application_1423780884992_0009
2015-02-12 14:45:12,422 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:12,422 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:12,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:45:12,549 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:12,551 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000004
2015-02-12 14:45:12,551 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000004
2015-02-12 14:45:12,551 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:45:12,551 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000004
2015-02-12 14:45:12,570 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0009_01_000004 is : 143
2015-02-12 14:45:12,582 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:12,583 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000004
2015-02-12 14:45:12,583 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000004
2015-02-12 14:45:12,583 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000004
2015-02-12 14:45:12,584 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000004
2015-02-12 14:45:12,586 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000004
2015-02-12 14:45:12,586 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:12,588 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000004 from application application_1423780884992_0009
2015-02-12 14:45:12,588 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:12,589 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:12,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:45:12,634 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:12,638 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000005
2015-02-12 14:45:12,638 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000005
2015-02-12 14:45:12,638 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:45:12,639 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000005
2015-02-12 14:45:12,666 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0009_01_000005 is : 143
2015-02-12 14:45:12,678 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:12,679 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000005
2015-02-12 14:45:12,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000005
2015-02-12 14:45:12,682 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000005
2015-02-12 14:45:12,682 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000005
2015-02-12 14:45:12,683 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000005
2015-02-12 14:45:12,683 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:12,683 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000005 from application application_1423780884992_0009
2015-02-12 14:45:12,683 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:12,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:12,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:45:12,715 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:12,719 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000006
2015-02-12 14:45:12,719 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000006
2015-02-12 14:45:12,719 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:45:12,721 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000006
2015-02-12 14:45:12,742 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0009_01_000006 is : 143
2015-02-12 14:45:12,752 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:12,752 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000006
2015-02-12 14:45:12,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000006
2015-02-12 14:45:12,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000006
2015-02-12 14:45:12,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000006
2015-02-12 14:45:12,754 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000006
2015-02-12 14:45:12,754 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:12,755 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000006 from application application_1423780884992_0009
2015-02-12 14:45:12,755 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:12,755 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:13,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:13,388 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:45:13,388 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000002
2015-02-12 14:45:13,388 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:45:13,388 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000002 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:45:13,388 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:13,557 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:13,557 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:45:13,557 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000004
2015-02-12 14:45:13,557 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:13,558 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:13,644 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:13,644 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:45:13,644 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000005
2015-02-12 14:45:13,645 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:13,645 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:13,726 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:13,727 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:45:13,727 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000006
2015-02-12 14:45:13,727 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:13,727 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000006 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:13,728 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:13,728 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000007
2015-02-12 14:45:13,728 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0009_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:14,392 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0009_01_000003]
2015-02-12 14:45:14,392 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:14,393 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:14,561 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:14,648 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:14,677 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:14,689 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:14,691 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0009_01_000007 by user soberoi
2015-02-12 14:45:14,691 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000007
2015-02-12 14:45:14,691 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0009_01_000007 to application application_1423780884992_0009
2015-02-12 14:45:14,692 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:45:14,692 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0009
2015-02-12 14:45:14,692 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0009
2015-02-12 14:45:14,692 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:14,692 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0009
2015-02-12 14:45:14,693 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:14,728 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:14,728 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:14,735 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:14,735 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:14,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000007/default_container_executor.sh]
2015-02-12 14:45:15,394 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0009_01_000002]
2015-02-12 14:45:15,395 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:15,566 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0009_01_000004]
2015-02-12 14:45:15,566 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:15,650 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0009_01_000005]
2015-02-12 14:45:15,650 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:15,683 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:45:15,730 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0009_01_000006]
2015-02-12 14:45:15,731 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:17,260 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:17,264 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:17,267 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:17,269 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:17,279 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:17,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,564 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:17,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105 src: /127.0.0.1:51634 dest: /127.0.0.1:50549
2015-02-12 14:45:17,662 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105 src: /127.0.0.1:51635 dest: /127.0.0.1:50543
2015-02-12 14:45:17,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105 src: /127.0.0.1:51636 dest: /127.0.0.1:50546
2015-02-12 14:45:17,700 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51636, dest: /127.0.0.1:50546, bytes: 63, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0009_r_000000_0_292228048_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105, duration: 35070000
2015-02-12 14:45:17,700 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:17,701 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,701 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51635, dest: /127.0.0.1:50543, bytes: 63, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0009_r_000000_0_292228048_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105, duration: 36080000
2015-02-12 14:45:17,701 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,702 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51634, dest: /127.0.0.1:50549, bytes: 63, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0009_r_000000_0_292228048_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105, duration: 37662000
2015-02-12 14:45:17,703 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,704 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,705 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,710 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0009_r_000000_0_292228048_1
2015-02-12 14:45:17,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:45:17,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:45:17,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/task_1423780884992_0009_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:45:17,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/_temporary/attempt_1423780884992_0009_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/task_1423780884992_0009_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:45:17,756 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:17,759 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000007
2015-02-12 14:45:17,759 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000007
2015-02-12 14:45:17,759 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:45:17,759 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000007
2015-02-12 14:45:17,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,780 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:45:17,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:17,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:17,818 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0009_01_000007 is : 143
2015-02-12 14:45:17,821 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:17,822 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000007
2015-02-12 14:45:17,822 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000007
2015-02-12 14:45:17,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000007
2015-02-12 14:45:17,825 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000007
2015-02-12 14:45:17,826 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000007
2015-02-12 14:45:17,826 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:17,827 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000007 from application application_1423780884992_0009
2015-02-12 14:45:17,827 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:17,827 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:17,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/task_1423780884992_0009_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:45:17,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:17,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary/1/task_1423780884992_0009_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary dst=null perm=null proto=rpc
2015-02-12 14:45:17,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,850 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_SUCCESS is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,856 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,875 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51621, dest: /127.0.0.1:50546, bytes: 69181, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104, duration: 5616947000
2015-02-12 14:45:17,875 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:17,876 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16368
2015-02-12 14:45:17,876 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51620, dest: /127.0.0.1:50549, bytes: 69181, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104, duration: 5616882000
2015-02-12 14:45:17,877 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,878 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16368
2015-02-12 14:45:17,878 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51619, dest: /127.0.0.1:50539, bytes: 69181, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104, duration: 5620052000
2015-02-12 14:45:17,879 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,880 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16368
2015-02-12 14:45:17,881 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,887 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:45:17,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106 src: /127.0.0.1:51638 dest: /127.0.0.1:50549
2015-02-12 14:45:17,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106 src: /127.0.0.1:51639 dest: /127.0.0.1:50546
2015-02-12 14:45:17,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106 src: /127.0.0.1:51640 dest: /127.0.0.1:50539
2015-02-12 14:45:17,897 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51640, dest: /127.0.0.1:50539, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106, duration: 1517000
2015-02-12 14:45:17,897 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:17,897 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:45:17,898 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51639, dest: /127.0.0.1:50546, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106, duration: 2090000
2015-02-12 14:45:17,898 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,898 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,898 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51638, dest: /127.0.0.1:50549, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106, duration: 2981000
2015-02-12 14:45:17,899 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,899 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,901 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:17,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:45:17,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:17,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:45:17,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:17,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:45:17,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,935 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:45:17,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107 src: /127.0.0.1:51642 dest: /127.0.0.1:50549
2015-02-12 14:45:17,939 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107 src: /127.0.0.1:51643 dest: /127.0.0.1:50546
2015-02-12 14:45:17,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107 src: /127.0.0.1:51644 dest: /127.0.0.1:50543
2015-02-12 14:45:17,944 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51644, dest: /127.0.0.1:50543, bytes: 69181, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107, duration: 2245000
2015-02-12 14:45:17,944 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:17,944 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51643, dest: /127.0.0.1:50546, bytes: 69181, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107, duration: 2964000
2015-02-12 14:45:17,945 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,945 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,945 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,945 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51642, dest: /127.0.0.1:50549, bytes: 69181, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107, duration: 3852000
2015-02-12 14:45:17,946 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,947 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,949 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:17,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:45:17,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:17,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:45:17,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:17,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009/job_1423780884992_0009_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:45:17,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:17,968 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:45:17,972 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108 src: /127.0.0.1:51645 dest: /127.0.0.1:50549
2015-02-12 14:45:17,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108 src: /127.0.0.1:51646 dest: /127.0.0.1:50543
2015-02-12 14:45:17,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108 src: /127.0.0.1:51647 dest: /127.0.0.1:50539
2015-02-12 14:45:17,985 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51647, dest: /127.0.0.1:50539, bytes: 114790, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108, duration: 4297000
2015-02-12 14:45:17,986 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:17,986 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51646, dest: /127.0.0.1:50543, bytes: 114790, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108, duration: 4033000
2015-02-12 14:45:17,987 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,987 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:45:17,988 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51645, dest: /127.0.0.1:50549, bytes: 114790, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_436245222_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108, duration: 5315000
2015-02-12 14:45:17,988 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:17,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:17,991 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_436245222_1
2015-02-12 14:45:17,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:17,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:17,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:18,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:18,012 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0009_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:45:18,012 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:45:18,012 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0009 with final state: FINISHING
2015-02-12 14:45:18,012 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from RUNNING to FINAL_SAVING
2015-02-12 14:45:18,013 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:45:18,013 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0009
2015-02-12 14:45:18,014 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from FINAL_SAVING to FINISHING
2015-02-12 14:45:18,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:18,767 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:45:18,767 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000007
2015-02-12 14:45:18,767 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:18,768 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000007 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:19,022 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0009 unregistered successfully.
2015-02-12 14:45:19,027 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741922_1098 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:45:19,027 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741923_1099 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:45:19,027 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741924_1100 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:45:19,028 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741925_1101 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:45:19,028 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741927_1103 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:45:19,028 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741928_1104 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:45:19,028 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741926_1102 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:45:19,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0009 dst=null perm=null proto=rpc
2015-02-12 14:45:19,062 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741918_1094 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:45:19,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/5739131188_source20_source101_7F891EE41612429CB6226FF2D1E7DD65 dst=null perm=null proto=rpc
2015-02-12 14:45:19,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,064 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary
2015-02-12 14:45:19,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/_temporary dst=null perm=null proto=rpc
2015-02-12 14:45:19,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,081 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:19,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:19,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,103 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:19,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:19,106 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1
2015-02-12 14:45:19,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1 dst=null perm=null proto=rpc
2015-02-12 14:45:19,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:19,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroupopt1/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:19,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,134 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:45:19,134 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:45:19,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:45:19,162 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting
2015-02-12 14:45:19,162 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:45:19,163 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:45:19,163 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:45:19,163 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup"]
2015-02-12 14:45:19,163 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] parallel execution is enabled: true
2015-02-12 14:45:19,163 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting jobs: 2
2015-02-12 14:45:19,163 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] allocating threads: 2
2015-02-12 14:45:19,165 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (2/2)
2015-02-12 14:45:19,175 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:45:19,192 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:45:19,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:19,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:45:19,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:45:19,201 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 10
2015-02-12 14:45:19,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010 dst=null perm=null proto=rpc
2015-02-12 14:45:19,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:45:19,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:45:19,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,213 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:45:19,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 src: /127.0.0.1:51652 dest: /127.0.0.1:50539
2015-02-12 14:45:19,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 src: /127.0.0.1:51653 dest: /127.0.0.1:50543
2015-02-12 14:45:19,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 src: /127.0.0.1:51654 dest: /127.0.0.1:50546
2015-02-12 14:45:19,223 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51654, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109, duration: 2220000
2015-02-12 14:45:19,223 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:19,224 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51653, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109, duration: 3579000
2015-02-12 14:45:19,224 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,224 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,226 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51652, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109, duration: 4952000
2015-02-12 14:45:19,226 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,228 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,230 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:19,235 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar
2015-02-12 14:45:19,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:45:19,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:45:19,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:45:19,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:45:19,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:45:19,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,250 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:19,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,256 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:19,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,259 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:19,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,264 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:19,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:19,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,269 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split
2015-02-12 14:45:19,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:19,271 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:19,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110 src: /127.0.0.1:51655 dest: /127.0.0.1:50549
2015-02-12 14:45:19,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110 src: /127.0.0.1:51656 dest: /127.0.0.1:50539
2015-02-12 14:45:19,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110 src: /127.0.0.1:51657 dest: /127.0.0.1:50543
2015-02-12 14:45:19,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110 src: /127.0.0.1:51658 dest: /127.0.0.1:50546
2015-02-12 14:45:19,281 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51658, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, duration: 1867000
2015-02-12 14:45:19,282 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:19,282 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,283 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51657, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, duration: 2314000
2015-02-12 14:45:19,283 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,284 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51656, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, duration: 3949000
2015-02-12 14:45:19,284 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,286 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51655, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, duration: 5688000
2015-02-12 14:45:19,286 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,287 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,289 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:19,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,294 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:45:19,296 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111 src: /127.0.0.1:51659 dest: /127.0.0.1:50546
2015-02-12 14:45:19,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111 src: /127.0.0.1:51660 dest: /127.0.0.1:50539
2015-02-12 14:45:19,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111 src: /127.0.0.1:51661 dest: /127.0.0.1:50549
2015-02-12 14:45:19,302 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51661, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111, duration: 1630000
2015-02-12 14:45:19,302 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:19,303 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:45:19,303 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51660, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111, duration: 1922000
2015-02-12 14:45:19,303 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,303 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:45:19,304 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51659, dest: /127.0.0.1:50546, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111, duration: 2794000
2015-02-12 14:45:19,304 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,310 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:45:19,311 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:19,311 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:45:19,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:19,322 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:45:19,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112 src: /127.0.0.1:51662 dest: /127.0.0.1:50546
2015-02-12 14:45:19,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112 src: /127.0.0.1:51663 dest: /127.0.0.1:50543
2015-02-12 14:45:19,329 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112 src: /127.0.0.1:51664 dest: /127.0.0.1:50549
2015-02-12 14:45:19,332 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51664, dest: /127.0.0.1:50549, bytes: 97369, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112, duration: 1638000
2015-02-12 14:45:19,333 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:19,334 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:45:19,334 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51663, dest: /127.0.0.1:50543, bytes: 97369, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112, duration: 2878000
2015-02-12 14:45:19,334 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,334 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:45:19,336 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51662, dest: /127.0.0.1:50546, bytes: 97369, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112, duration: 4575000
2015-02-12 14:45:19,336 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:19,337 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:19,339 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:19,339 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0010
2015-02-12 14:45:19,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010 dst=null perm=null proto=rpc
2015-02-12 14:45:19,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:19,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:19,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:19,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:19,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:19,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:19,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,356 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 10 submitted by user soberoi
2015-02-12 14:45:19,356 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0010
2015-02-12 14:45:19,356 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from NEW to NEW_SAVING
2015-02-12 14:45:19,356 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0010
2015-02-12 14:45:19,357 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0010
2015-02-12 14:45:19,357 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:45:19,357 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0010 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:45:19,358 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from SUBMITTED to ACCEPTED
2015-02-12 14:45:19,358 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0010_000001
2015-02-12 14:45:19,359 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from NEW to SUBMITTED
2015-02-12 14:45:19,359 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0010_000001 to scheduler from user: soberoi
2015-02-12 14:45:19,360 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:45:19,360 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0010
2015-02-12 14:45:19,362 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0010/
2015-02-12 14:45:19,362 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1423780884992_0010
2015-02-12 14:45:19,362 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0010/
2015-02-12 14:45:19,407 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:19,407 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000001
2015-02-12 14:45:19,407 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:45:19,407 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0010_01_000001
2015-02-12 14:45:19,408 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:19,408 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0010_000001
2015-02-12 14:45:19,408 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0010 AttemptId: appattempt_1423780884992_0010_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0010_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:45:19,408 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:45:19,409 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:45:19,410 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0010_000001
2015-02-12 14:45:19,412 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0010_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0010_000001
2015-02-12 14:45:19,412 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0010_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:45:19,412 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0010_000001
2015-02-12 14:45:19,413 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0010_000001
2015-02-12 14:45:19,415 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:19,417 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000001 by user soberoi
2015-02-12 14:45:19,418 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0010
2015-02-12 14:45:19,418 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000001
2015-02-12 14:45:19,419 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from NEW to INITING
2015-02-12 14:45:19,419 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000001 to application application_1423780884992_0010
2015-02-12 14:45:19,419 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from INITING to RUNNING
2015-02-12 14:45:19,420 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0010_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0010_000001
2015-02-12 14:45:19,420 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:45:19,420 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:45:19,420 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:19,421 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:19,421 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:45:19,422 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:45:19,422 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:19,422 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0010_01_000001
2015-02-12 14:45:19,435 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0010_01_000001.tokens. Credentials list:
2015-02-12 14:45:19,546 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:19,643 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0010_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000001.tokens
2015-02-12 14:45:19,643 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:19,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:19,767 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:19,771 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0010/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:19,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:19,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:19,835 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:19,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:19,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:19,898 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0010/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:19,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:19,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:19,967 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0010/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:19,967 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:20,004 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:20,004 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:20,113 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000001/default_container_executor.sh]
2015-02-12 14:45:20,410 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:20,769 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:21,687 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073741933_1109 to datanode(s) 127.0.0.1:50549
2015-02-12 14:45:21,687 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741922_1098, blk_1073741923_1099, blk_1073741924_1100, blk_1073741926_1102, blk_1073741928_1104, blk_1073741918_1094]
2015-02-12 14:45:21,687 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741922_1098, blk_1073741923_1099, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103, blk_1073741928_1104, blk_1073741918_1094]
2015-02-12 14:45:21,771 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:21,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:45:21,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:45:21,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:45:21,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:45:22,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010 dst=null perm=null proto=rpc
2015-02-12 14:45:22,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:45:22,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:45:22,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:22,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:22,536 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 14:45:22,536 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 14:45:22,536 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741924 for deletion
2015-02-12 14:45:22,536 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741926 for deletion
2015-02-12 14:45:22,536 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 14:45:22,537 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 14:45:22,537 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741924
2015-02-12 14:45:22,537 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741928 for deletion
2015-02-12 14:45:22,537 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741926
2015-02-12 14:45:22,537 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741918 for deletion
2015-02-12 14:45:22,537 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741928
2015-02-12 14:45:22,538 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741918
2015-02-12 14:45:22,772 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:22,919 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 to 127.0.0.1:50549
2015-02-12 14:45:22,920 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 src: /127.0.0.1:51674 dest: /127.0.0.1:50549
2015-02-12 14:45:22,921 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:45:22,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109 src: /127.0.0.1:51674 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:45:22,924 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741933_1109 size 254067
2015-02-12 14:45:23,183 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 14:45:23,183 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741925 for deletion
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741926 for deletion
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741927 for deletion
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741925
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741926
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741928 for deletion
2015-02-12 14:45:23,185 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741918 for deletion
2015-02-12 14:45:23,184 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 14:45:23,185 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741927
2015-02-12 14:45:23,185 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741928
2015-02-12 14:45:23,185 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741918
2015-02-12 14:45:23,456 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:23,458 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0010_000001
2015-02-12 14:45:23,459 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0010 APPATTEMPTID=appattempt_1423780884992_0010_000001
2015-02-12 14:45:23,459 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:45:23,459 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from ACCEPTED to RUNNING
2015-02-12 14:45:23,531 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 895 Total time for transactions(ms): 97 Number of transactions batched in Syncs: 4 Number of syncs: 608 SyncTimes(ms): 213 132
2015-02-12 14:45:23,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:23,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:45:23,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:23,776 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:23,859 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:23,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113 src: /127.0.0.1:51678 dest: /127.0.0.1:50549
2015-02-12 14:45:23,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113 src: /127.0.0.1:51679 dest: /127.0.0.1:50539
2015-02-12 14:45:23,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113 src: /127.0.0.1:51680 dest: /127.0.0.1:50546
2015-02-12 14:45:23,945 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51680, dest: /127.0.0.1:50546, bytes: 114222, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113, duration: 30444000
2015-02-12 14:45:23,945 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:23,946 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:45:23,946 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51679, dest: /127.0.0.1:50539, bytes: 114222, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113, duration: 31270000
2015-02-12 14:45:23,946 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:23,949 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:45:23,949 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51678, dest: /127.0.0.1:50549, bytes: 114222, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113, duration: 33650000
2015-02-12 14:45:23,950 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:45:23,950 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:23,960 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:23,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:23,998 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:45:24,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114 src: /127.0.0.1:51681 dest: /127.0.0.1:50549
2015-02-12 14:45:24,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114 src: /127.0.0.1:51682 dest: /127.0.0.1:50539
2015-02-12 14:45:24,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114 src: /127.0.0.1:51683 dest: /127.0.0.1:50543
2015-02-12 14:45:24,009 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51683, dest: /127.0.0.1:50543, bytes: 374, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114, duration: 1738000
2015-02-12 14:45:24,009 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:24,010 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:45:24,011 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51682, dest: /127.0.0.1:50539, bytes: 374, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114, duration: 2727000
2015-02-12 14:45:24,011 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:24,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:24,012 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51681, dest: /127.0.0.1:50549, bytes: 374, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114, duration: 3680000
2015-02-12 14:45:24,012 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:24,013 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:24,015 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010.summary is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:24,078 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0009_01_000001 succeeded
2015-02-12 14:45:24,078 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:45:24,078 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0009_01_000001
2015-02-12 14:45:24,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000001
2015-02-12 14:45:24,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000001
2015-02-12 14:45:24,095 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000001
2015-02-12 14:45:24,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0009/container_1423780884992_0009_01_000001
2015-02-12 14:45:24,097 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000001
2015-02-12 14:45:24,097 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0009_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:45:24,097 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0009_01_000001 from application application_1423780884992_0009
2015-02-12 14:45:24,097 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:24,097 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0009
2015-02-12 14:45:24,416 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0009_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:24,416 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0009_000001
2015-02-12 14:45:24,417 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0009_000001
2015-02-12 14:45:24,416 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0009_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:45:24,417 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000001
2015-02-12 14:45:24,417 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:45:24,418 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0009_000001 released container container_1423780884992_0009_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:45:24,417 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0009_000001 State change from FINISHING to FINISHED
2015-02-12 14:45:24,418 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0009 State change from FINISHING to FINISHED
2015-02-12 14:45:24,418 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0009_000001 is done. finalState=FINISHED
2015-02-12 14:45:24,419 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0009_000001
2015-02-12 14:45:24,419 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0009
2015-02-12 14:45:24,419 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0009 requests cleared
2015-02-12 14:45:24,419 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0009,name=[3E9AC9D77F2F4953978740D284E1A487/D5BF53CC409946A7B2F6430D1CA3BCA5] cogroupopt/(1/2) ...tform/cogroupacogroupopt1,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0009/jobhistory/job/job_1423780884992_0009,appMasterHost=10.1.1.67,startTime=1423781095543,finishTime=1423781118012,finalStatus=SUCCEEDED
2015-02-12 14:45:24,422 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0009_000001 (auth:SIMPLE)
2015-02-12 14:45:24,424 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0009_01_000001
2015-02-12 14:45:24,424 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0009 CONTAINERID=container_1423780884992_0009_01_000001
2015-02-12 14:45:24,425 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0009_01_000001]
2015-02-12 14:45:24,425 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:24,425 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:24,425 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,426 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0009
2015-02-12 14:45:24,426 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:24,426 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0009, with delay of 10800 seconds
2015-02-12 14:45:24,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,599 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:24,599 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:24,599 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000002
2015-02-12 14:45:24,599 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:24,599 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,600 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0009
2015-02-12 14:45:24,600 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,600 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:24,600 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0009, with delay of 10800 seconds
2015-02-12 14:45:24,600 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,601 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,671 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:24,671 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:24,671 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000003
2015-02-12 14:45:24,672 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:24,672 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,672 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,673 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,673 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0009
2015-02-12 14:45:24,675 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:24,675 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0009, with delay of 10800 seconds
2015-02-12 14:45:24,691 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741922_1098, blk_1073741923_1099, blk_1073741924_1100, blk_1073741925_1101, blk_1073741927_1103, blk_1073741928_1104]
2015-02-12 14:45:24,692 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741922_1098, blk_1073741923_1099, blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103, blk_1073741918_1094]
2015-02-12 14:45:24,777 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:24,777 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:24,778 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:24,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,778 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000004
2015-02-12 14:45:24,779 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0009
2015-02-12 14:45:24,779 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:24,779 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0009, with delay of 10800 seconds
2015-02-12 14:45:24,780 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:24,779 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:24,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0009
2015-02-12 14:45:25,430 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:25,430 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000005
2015-02-12 14:45:25,431 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:45:25,540 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 14:45:25,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 14:45:25,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741924 for deletion
2015-02-12 14:45:25,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 14:45:25,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741925 for deletion
2015-02-12 14:45:25,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741926 for deletion
2015-02-12 14:45:25,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741927 for deletion
2015-02-12 14:45:25,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 14:45:25,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741918 for deletion
2015-02-12 14:45:25,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741924
2015-02-12 14:45:25,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741925
2015-02-12 14:45:25,543 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741926
2015-02-12 14:45:25,543 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741927
2015-02-12 14:45:25,544 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741918
2015-02-12 14:45:25,549 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0010_01_000002
2015-02-12 14:45:25,550 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:25,550 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0010_01_000003
2015-02-12 14:45:25,550 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:25,550 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0010_01_000004
2015-02-12 14:45:25,551 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:25,551 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0010_01_000005
2015-02-12 14:45:25,551 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:25,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,601 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:25,601 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000006
2015-02-12 14:45:25,602 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:45:25,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:25,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:25,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:25,672 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:25,673 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000007
2015-02-12 14:45:25,673 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:45:25,703 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:25,704 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:25,703 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:25,704 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:25,708 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000004 by user soberoi
2015-02-12 14:45:25,708 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000005 by user soberoi
2015-02-12 14:45:25,708 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000003 by user soberoi
2015-02-12 14:45:25,708 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000005
2015-02-12 14:45:25,709 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000005 to application application_1423780884992_0010
2015-02-12 14:45:25,708 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000002 by user soberoi
2015-02-12 14:45:25,709 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:45:25,709 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,709 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,709 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:25,709 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:25,708 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0010
2015-02-12 14:45:25,710 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000003
2015-02-12 14:45:25,708 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0010
2015-02-12 14:45:25,710 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from NEW to INITING
2015-02-12 14:45:25,710 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000003 to application application_1423780884992_0010
2015-02-12 14:45:25,710 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from NEW to INITING
2015-02-12 14:45:25,710 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from INITING to RUNNING
2015-02-12 14:45:25,711 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:45:25,711 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,711 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,711 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:25,711 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:25,712 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:25,712 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:25,710 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:25,712 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0010_01_000003
2015-02-12 14:45:25,709 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0010
2015-02-12 14:45:25,713 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000002
2015-02-12 14:45:25,711 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000004 to application application_1423780884992_0010
2015-02-12 14:45:25,717 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from NEW to INITING
2015-02-12 14:45:25,717 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from INITING to RUNNING
2015-02-12 14:45:25,718 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:45:25,718 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,718 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,718 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:25,719 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:25,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:25,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:25,719 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0010_01_000004
2015-02-12 14:45:25,710 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000004
2015-02-12 14:45:25,717 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000002 to application application_1423780884992_0010
2015-02-12 14:45:25,722 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from INITING to RUNNING
2015-02-12 14:45:25,722 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:45:25,722 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,722 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:25,722 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:25,723 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:25,723 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:25,723 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:25,723 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0010_01_000002
2015-02-12 14:45:25,752 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0010_01_000003.tokens. Credentials list:
2015-02-12 14:45:25,756 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0010_01_000002.tokens. Credentials list:
2015-02-12 14:45:25,758 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0010_01_000004.tokens. Credentials list:
2015-02-12 14:45:25,779 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:25,779 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:25,791 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:25,791 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922 for deletion
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923 for deletion
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741924 for deletion
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741925 for deletion
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741927 for deletion
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741928 for deletion
2015-02-12 14:45:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741922
2015-02-12 14:45:25,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741923
2015-02-12 14:45:25,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741924
2015-02-12 14:45:25,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741925
2015-02-12 14:45:25,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741927
2015-02-12 14:45:25,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741928
2015-02-12 14:45:25,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:25,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:25,988 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:26,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000005/default_container_executor.sh]
2015-02-12 14:45:26,175 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0010_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000004.tokens
2015-02-12 14:45:26,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:26,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0010_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000002.tokens
2015-02-12 14:45:26,193 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:26,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0010_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000003.tokens
2015-02-12 14:45:26,203 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:26,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:26,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:26,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:26,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:26,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:26,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:26,426 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0010/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:26,430 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:26,444 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0010/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:26,445 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:26,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:26,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:26,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:26,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:26,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:26,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:26,568 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:26,569 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:26,576 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0010/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:26,577 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:26,581 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:26,582 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:26,584 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000006 by user soberoi
2015-02-12 14:45:26,584 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000006
2015-02-12 14:45:26,584 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000006 to application application_1423780884992_0010
2015-02-12 14:45:26,585 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:45:26,585 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000007 by user soberoi
2015-02-12 14:45:26,585 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000007
2015-02-12 14:45:26,585 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:26,585 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:26,585 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:26,585 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:26,586 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0010_01_000006
2015-02-12 14:45:26,585 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000007 to application application_1423780884992_0010
2015-02-12 14:45:26,587 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:45:26,587 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:26,587 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:26,587 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:26,587 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:26,592 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0010_01_000007
2015-02-12 14:45:26,600 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0010/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:26,600 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:26,600 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:26,601 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:26,602 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:26,602 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:26,602 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000008
2015-02-12 14:45:26,602 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:45:26,616 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0010_01_000006.tokens. Credentials list:
2015-02-12 14:45:26,631 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0010_01_000007.tokens. Credentials list:
2015-02-12 14:45:26,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:26,662 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:26,664 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:26,674 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:26,674 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:26,674 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:26,674 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000009
2015-02-12 14:45:26,674 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:45:26,706 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:26,707 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:26,714 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:26,714 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:26,720 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:26,721 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:26,770 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:26,770 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:26,770 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:26,770 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:26,773 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107
2015-02-12 14:45:26,774 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105
2015-02-12 14:45:26,775 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109
2015-02-12 14:45:26,776 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110
2015-02-12 14:45:26,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108
2015-02-12 14:45:26,978 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112
2015-02-12 14:45:27,007 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000007/default_container_executor.sh]
2015-02-12 14:45:27,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000003/default_container_executor.sh]
2015-02-12 14:45:27,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000004/default_container_executor.sh]
2015-02-12 14:45:27,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000002/default_container_executor.sh]
2015-02-12 14:45:27,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000006/default_container_executor.sh]
2015-02-12 14:45:27,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108
2015-02-12 14:45:27,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110
2015-02-12 14:45:27,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111
2015-02-12 14:45:27,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106
2015-02-12 14:45:27,511 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109
2015-02-12 14:45:27,541 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107
2015-02-12 14:45:27,541 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106
2015-02-12 14:45:27,542 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112
2015-02-12 14:45:27,542 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110
2015-02-12 14:45:27,543 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105
2015-02-12 14:45:27,578 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:45:27,579 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:27,580 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:27,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741929_1105
2015-02-12 14:45:27,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741931_1107
2015-02-12 14:45:27,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741930_1106
2015-02-12 14:45:27,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111
2015-02-12 14:45:27,636 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741932_1108
2015-02-12 14:45:27,654 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:27,698 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:27,743 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109
2015-02-12 14:45:27,744 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741935_1111
2015-02-12 14:45:27,798 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0010_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000007.tokens
2015-02-12 14:45:27,799 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:27,835 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741936_1112
2015-02-12 14:45:27,836 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741934_1110
2015-02-12 14:45:27,851 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0010_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000006.tokens
2015-02-12 14:45:27,852 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:28,588 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:45:28,588 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:45:28,588 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000008
2015-02-12 14:45:28,588 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:45:28,588 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000008 on node: host: 10.1.1.67:50571 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:45:28,588 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:45:28,589 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:45:28,589 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000009
2015-02-12 14:45:28,589 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:45:28,589 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000009 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:45:28,607 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0010_01_000008
2015-02-12 14:45:28,678 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0010_01_000009
2015-02-12 14:45:31,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114
2015-02-12 14:45:32,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113
2015-02-12 14:45:32,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114
2015-02-12 14:45:32,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113
2015-02-12 14:45:32,841 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741937_1113
2015-02-12 14:45:32,841 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741938_1114
2015-02-12 14:45:32,843 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741933_1109
2015-02-12 14:45:37,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:37,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:37,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:37,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:37,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:37,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:37,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:37,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:37,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:37,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:37,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:45:37,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:38,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:45:38,262 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:38,264 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000005
2015-02-12 14:45:38,264 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000005
2015-02-12 14:45:38,264 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:45:38,264 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000005
2015-02-12 14:45:38,290 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000005 is : 143
2015-02-12 14:45:38,301 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:38,301 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:38,302 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000005
2015-02-12 14:45:38,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000005
2015-02-12 14:45:38,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115 src: /127.0.0.1:51727 dest: /127.0.0.1:50543
2015-02-12 14:45:38,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000005
2015-02-12 14:45:38,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000005
2015-02-12 14:45:38,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115 src: /127.0.0.1:51728 dest: /127.0.0.1:50549
2015-02-12 14:45:38,306 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000005
2015-02-12 14:45:38,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115 src: /127.0.0.1:51729 dest: /127.0.0.1:50546
2015-02-12 14:45:38,309 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:38,309 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000005 from application application_1423780884992_0010
2015-02-12 14:45:38,310 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:38,310 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:38,323 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist for DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:38,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:45:38,638 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:38,640 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000003
2015-02-12 14:45:38,641 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000003
2015-02-12 14:45:38,641 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:45:38,641 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000003
2015-02-12 14:45:38,662 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000003 is : 143
2015-02-12 14:45:38,673 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:38,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000003
2015-02-12 14:45:38,675 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000003
2015-02-12 14:45:38,675 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000003
2015-02-12 14:45:38,675 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:38,675 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000003 from application application_1423780884992_0010
2015-02-12 14:45:38,675 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000003
2015-02-12 14:45:38,675 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:38,678 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:38,675 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000003
2015-02-12 14:45:38,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:45:38,728 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:38,731 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000007
2015-02-12 14:45:38,731 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000007
2015-02-12 14:45:38,731 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:45:38,732 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000007
2015-02-12 14:45:38,734 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:38,734 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:45:38,735 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000003
2015-02-12 14:45:38,735 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:45:38,735 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000003 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:45:38,768 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000007 is : 143
2015-02-12 14:45:38,783 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:38,784 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000007
2015-02-12 14:45:38,785 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000007
2015-02-12 14:45:38,785 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000007
2015-02-12 14:45:38,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000007
2015-02-12 14:45:38,787 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000007
2015-02-12 14:45:38,787 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:38,787 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000007 from application application_1423780884992_0010
2015-02-12 14:45:38,787 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:38,787 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:38,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:45:38,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:45:38,845 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:38,848 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000004
2015-02-12 14:45:38,848 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000004
2015-02-12 14:45:38,848 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:45:38,848 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000004
2015-02-12 14:45:38,874 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000004 is : 143
2015-02-12 14:45:38,899 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:38,902 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000006
2015-02-12 14:45:38,902 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:38,902 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:45:38,902 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000006
2015-02-12 14:45:38,902 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000006
2015-02-12 14:45:38,903 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000004
2015-02-12 14:45:38,904 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000004
2015-02-12 14:45:38,905 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:38,905 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000004 from application application_1423780884992_0010
2015-02-12 14:45:38,905 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:38,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000004
2015-02-12 14:45:38,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000004
2015-02-12 14:45:38,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000004
2015-02-12 14:45:38,905 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:38,937 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000006 is : 143
2015-02-12 14:45:38,948 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:38,949 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000006
2015-02-12 14:45:38,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000006
2015-02-12 14:45:38,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000006
2015-02-12 14:45:38,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000006
2015-02-12 14:45:38,957 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000006
2015-02-12 14:45:38,957 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:38,958 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000006 from application application_1423780884992_0010
2015-02-12 14:45:38,958 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:38,958 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:38,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:45:39,021 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:39,023 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000002
2015-02-12 14:45:39,024 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000002
2015-02-12 14:45:39,024 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:45:39,024 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000002
2015-02-12 14:45:39,025 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:39,025 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:45:39,025 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000006
2015-02-12 14:45:39,025 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:45:39,025 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:45:39,052 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000002 is : 143
2015-02-12 14:45:39,065 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:39,067 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000002
2015-02-12 14:45:39,067 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000002
2015-02-12 14:45:39,067 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000002
2015-02-12 14:45:39,068 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000002
2015-02-12 14:45:39,068 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000002
2015-02-12 14:45:39,069 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:39,069 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000002 from application application_1423780884992_0010
2015-02-12 14:45:39,070 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:39,071 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:39,267 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:39,268 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:45:39,268 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000005
2015-02-12 14:45:39,268 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:45:39,268 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000005 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:45:39,544 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30006 milliseconds
2015-02-12 14:45:39,544 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:45:39,737 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:39,737 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:39,737 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:45:39,737 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000007
2015-02-12 14:45:39,737 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:39,738 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000007 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:39,738 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:39,738 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000010
2015-02-12 14:45:39,739 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0010_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:39,856 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:39,856 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:45:39,856 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000004
2015-02-12 14:45:39,856 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:39,856 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:40,028 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:40,029 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:45:40,029 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000002
2015-02-12 14:45:40,029 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:40,029 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000002 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:40,029 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:40,271 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:40,660 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:40,672 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:40,673 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0010_01_000010 by user soberoi
2015-02-12 14:45:40,674 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000010
2015-02-12 14:45:40,674 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0010_01_000010 to application application_1423780884992_0010
2015-02-12 14:45:40,674 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 14:45:40,674 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0010
2015-02-12 14:45:40,674 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0010
2015-02-12 14:45:40,674 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:40,675 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0010
2015-02-12 14:45:40,675 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:40,705 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:40,705 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:40,737 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000003]
2015-02-12 14:45:40,737 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:40,737 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:40,737 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:40,812 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000010/default_container_executor.sh]
2015-02-12 14:45:40,861 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:41,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000006]
2015-02-12 14:45:41,032 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:41,032 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:41,272 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000005]
2015-02-12 14:45:41,272 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:41,664 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:45:41,738 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000007]
2015-02-12 14:45:41,738 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:41,866 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000004]
2015-02-12 14:45:41,866 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:42,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000002]
2015-02-12 14:45:42,032 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:43,244 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:43,251 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:43,259 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:43,260 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:43,262 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:43,265 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:45:43,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,554 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:45:43,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116 src: /127.0.0.1:51747 dest: /127.0.0.1:50546
2015-02-12 14:45:43,652 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116 src: /127.0.0.1:51748 dest: /127.0.0.1:50549
2015-02-12 14:45:43,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116 src: /127.0.0.1:51749 dest: /127.0.0.1:50539
2015-02-12 14:45:43,692 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51749, dest: /127.0.0.1:50539, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0010_r_000000_0_-302938581_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116, duration: 36774000
2015-02-12 14:45:43,692 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:43,693 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:45:43,693 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51748, dest: /127.0.0.1:50549, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0010_r_000000_0_-302938581_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116, duration: 37635000
2015-02-12 14:45:43,693 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,695 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51747, dest: /127.0.0.1:50546, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0010_r_000000_0_-302938581_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116, duration: 39363000
2015-02-12 14:45:43,695 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,695 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:45:43,697 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,700 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0010_r_000000_0_-302938581_1
2015-02-12 14:45:43,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:45:43,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:45:43,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/task_1423780884992_0010_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:45:43,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/_temporary/attempt_1423780884992_0010_r_000000_0 dst=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/task_1423780884992_0010_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:45:43,743 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:43,745 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000010
2015-02-12 14:45:43,745 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000010
2015-02-12 14:45:43,745 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000010 transitioned from RUNNING to KILLING
2015-02-12 14:45:43,746 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000010
2015-02-12 14:45:43,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,758 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:45:43,778 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0010_01_000010 is : 143
2015-02-12 14:45:43,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:43,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:43,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/task_1423780884992_0010_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:45:43,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:45:43,792 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:45:43,793 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000010
2015-02-12 14:45:43,793 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000010
2015-02-12 14:45:43,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000010
2015-02-12 14:45:43,794 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000010
2015-02-12 14:45:43,794 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:45:43,794 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000010 from application application_1423780884992_0010
2015-02-12 14:45:43,794 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:43,794 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:43,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000010
2015-02-12 14:45:43,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary/1/task_1423780884992_0010_r_000000/part-00000 dst=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_temporary dst=null perm=null proto=rpc
2015-02-12 14:45:43,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,813 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,819 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,838 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51729, dest: /127.0.0.1:50546, bytes: 75517, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115, duration: 5525249000
2015-02-12 14:45:43,839 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:43,839 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16998
2015-02-12 14:45:43,843 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51728, dest: /127.0.0.1:50549, bytes: 75517, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115, duration: 5529028000
2015-02-12 14:45:43,843 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16998
2015-02-12 14:45:43,846 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51727, dest: /127.0.0.1:50543, bytes: 75517, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115, duration: 5531910000
2015-02-12 14:45:43,846 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16998
2015-02-12 14:45:43,849 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,857 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:45:43,861 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117 src: /127.0.0.1:51751 dest: /127.0.0.1:50549
2015-02-12 14:45:43,863 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117 src: /127.0.0.1:51752 dest: /127.0.0.1:50543
2015-02-12 14:45:43,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117 src: /127.0.0.1:51754 dest: /127.0.0.1:50539
2015-02-12 14:45:43,869 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51754, dest: /127.0.0.1:50539, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117, duration: 2924000
2015-02-12 14:45:43,870 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:43,870 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51752, dest: /127.0.0.1:50543, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117, duration: 3588000
2015-02-12 14:45:43,870 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:45:43,871 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,872 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51751, dest: /127.0.0.1:50549, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117, duration: 5236000
2015-02-12 14:45:43,872 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:45:43,875 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:45:43,878 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary_tmp is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:43,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:45:43,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:43,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:45:43,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:43,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:45:43,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,914 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:45:43,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118 src: /127.0.0.1:51759 dest: /127.0.0.1:50549
2015-02-12 14:45:43,919 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118 src: /127.0.0.1:51760 dest: /127.0.0.1:50539
2015-02-12 14:45:43,920 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118 src: /127.0.0.1:51761 dest: /127.0.0.1:50546
2015-02-12 14:45:43,924 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51761, dest: /127.0.0.1:50546, bytes: 75517, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118, duration: 2240000
2015-02-12 14:45:43,924 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:43,925 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,925 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51760, dest: /127.0.0.1:50539, bytes: 75517, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118, duration: 3140000
2015-02-12 14:45:43,926 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,926 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,927 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51759, dest: /127.0.0.1:50549, bytes: 75517, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118, duration: 4748000
2015-02-12 14:45:43,927 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,928 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,934 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:43,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:45:43,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:43,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:45:43,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:45:43,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010/job_1423780884992_0010_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:45:43,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:43,958 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:45:43,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119 src: /127.0.0.1:51763 dest: /127.0.0.1:50543
2015-02-12 14:45:43,962 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119 src: /127.0.0.1:51764 dest: /127.0.0.1:50549
2015-02-12 14:45:43,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119 src: /127.0.0.1:51765 dest: /127.0.0.1:50539
2015-02-12 14:45:43,967 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51765, dest: /127.0.0.1:50539, bytes: 114222, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119, duration: 2308000
2015-02-12 14:45:43,967 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:43,968 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51764, dest: /127.0.0.1:50549, bytes: 114222, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119, duration: 3296000
2015-02-12 14:45:43,968 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,969 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,970 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51763, dest: /127.0.0.1:50543, bytes: 114222, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-118352737_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119, duration: 4773000
2015-02-12 14:45:43,970 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:43,972 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,972 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:43,974 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-118352737_1
2015-02-12 14:45:43,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:43,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:43,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:43,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:45:43,997 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0010_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:45:43,997 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:45:43,997 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0010 with final state: FINISHING
2015-02-12 14:45:43,998 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from RUNNING to FINAL_SAVING
2015-02-12 14:45:43,998 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0010
2015-02-12 14:45:43,998 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:45:43,998 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from FINAL_SAVING to FINISHING
2015-02-12 14:45:44,757 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:44,757 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 14:45:44,757 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000010
2015-02-12 14:45:44,757 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:45:44,757 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000010 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:45:45,007 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0010 unregistered successfully.
2015-02-12 14:45:45,011 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741933_1109 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:45:45,012 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741934_1110 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:45:45,012 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741935_1111 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:45:45,012 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741936_1112 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:45:45,012 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741938_1114 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:45:45,013 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741939_1115 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:45:45,013 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741937_1113 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:45:45,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0010 dst=null perm=null proto=rpc
2015-02-12 14:45:45,055 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (1/2) ...splatform/cogroupacogroup
2015-02-12 14:45:45,066 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:45:45,081 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:45:45,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:45:45,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:45:45,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:45:45,091 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 11
2015-02-12 14:45:45,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011 dst=null perm=null proto=rpc
2015-02-12 14:45:45,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:45:45,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:45:45,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,101 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:45:45,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 src: /127.0.0.1:51768 dest: /127.0.0.1:50543
2015-02-12 14:45:45,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 src: /127.0.0.1:51769 dest: /127.0.0.1:50549
2015-02-12 14:45:45,105 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 src: /127.0.0.1:51770 dest: /127.0.0.1:50539
2015-02-12 14:45:45,110 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51770, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120, duration: 3217000
2015-02-12 14:45:45,110 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:45,111 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51769, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120, duration: 3428000
2015-02-12 14:45:45,111 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,111 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,112 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,112 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51768, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120, duration: 4828000
2015-02-12 14:45:45,112 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,114 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,117 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:45,118 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar
2015-02-12 14:45:45,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:45:45,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:45:45,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:45:45,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:45:45,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:45:45,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:45,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:45,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:45,142 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:45,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:45,143 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:45,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:45,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:45,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:45,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:45:45,150 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:45,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:45,152 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:45:45,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:45:45,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,159 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split
2015-02-12 14:45:45,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:45,165 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:45:45,167 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121 src: /127.0.0.1:51771 dest: /127.0.0.1:50549
2015-02-12 14:45:45,168 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121 src: /127.0.0.1:51772 dest: /127.0.0.1:50543
2015-02-12 14:45:45,170 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121 src: /127.0.0.1:51773 dest: /127.0.0.1:50546
2015-02-12 14:45:45,172 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121 src: /127.0.0.1:51774 dest: /127.0.0.1:50539
2015-02-12 14:45:45,176 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51774, dest: /127.0.0.1:50539, bytes: 2139, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, duration: 1761000
2015-02-12 14:45:45,176 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:45,177 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,177 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51773, dest: /127.0.0.1:50546, bytes: 2139, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, duration: 1951000
2015-02-12 14:45:45,178 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,179 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,180 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51772, dest: /127.0.0.1:50543, bytes: 2139, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, duration: 5218000
2015-02-12 14:45:45,181 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,184 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51771, dest: /127.0.0.1:50549, bytes: 2139, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, duration: 8905000
2015-02-12 14:45:45,184 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,184 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,185 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,186 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:45,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,194 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:45:45,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122 src: /127.0.0.1:51775 dest: /127.0.0.1:50549
2015-02-12 14:45:45,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122 src: /127.0.0.1:51776 dest: /127.0.0.1:50539
2015-02-12 14:45:45,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122 src: /127.0.0.1:51777 dest: /127.0.0.1:50543
2015-02-12 14:45:45,202 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51777, dest: /127.0.0.1:50543, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122, duration: 1582000
2015-02-12 14:45:45,202 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:45,203 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,203 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51776, dest: /127.0.0.1:50539, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122, duration: 2371000
2015-02-12 14:45:45,203 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,204 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51775, dest: /127.0.0.1:50549, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122, duration: 3849000
2015-02-12 14:45:45,205 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,208 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,208 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:45,210 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:45,211 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:45:45,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:45:45,222 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:45:45,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123 src: /127.0.0.1:51778 dest: /127.0.0.1:50539
2015-02-12 14:45:45,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123 src: /127.0.0.1:51779 dest: /127.0.0.1:50543
2015-02-12 14:45:45,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123 src: /127.0.0.1:51780 dest: /127.0.0.1:50546
2015-02-12 14:45:45,230 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51780, dest: /127.0.0.1:50546, bytes: 97820, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123, duration: 1633000
2015-02-12 14:45:45,231 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:45,232 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:45:45,233 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51779, dest: /127.0.0.1:50543, bytes: 97820, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123, duration: 2792000
2015-02-12 14:45:45,234 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,234 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:45:45,235 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51778, dest: /127.0.0.1:50539, bytes: 97820, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123, duration: 5602000
2015-02-12 14:45:45,235 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:45,237 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:45:45,238 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:45:45,239 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0011
2015-02-12 14:45:45,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011 dst=null perm=null proto=rpc
2015-02-12 14:45:45,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:45,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:45,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:45,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:45,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:45,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:45,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,276 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 11 submitted by user soberoi
2015-02-12 14:45:45,276 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0011
2015-02-12 14:45:45,276 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0011
2015-02-12 14:45:45,276 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0011
2015-02-12 14:45:45,276 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from NEW to NEW_SAVING
2015-02-12 14:45:45,277 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:45:45,277 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0011 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:45:45,277 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from SUBMITTED to ACCEPTED
2015-02-12 14:45:45,277 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0011_000001
2015-02-12 14:45:45,278 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from NEW to SUBMITTED
2015-02-12 14:45:45,278 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0011_000001 to scheduler from user: soberoi
2015-02-12 14:45:45,279 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:45:45,279 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0011
2015-02-12 14:45:45,284 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0011/
2015-02-12 14:45:45,284 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1423780884992_0011
2015-02-12 14:45:45,284 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0011/
2015-02-12 14:45:45,288 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:45,288 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000001
2015-02-12 14:45:45,289 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:45:45,289 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0011_01_000001
2015-02-12 14:45:45,290 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:45,290 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0011_000001
2015-02-12 14:45:45,291 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0011 AttemptId: appattempt_1423780884992_0011_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0011_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:45:45,291 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:45:45,292 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:45:45,292 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0011_000001
2015-02-12 14:45:45,294 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0011_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0011_000001
2015-02-12 14:45:45,295 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0011_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:45:45,295 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0011_000001
2015-02-12 14:45:45,295 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0011_000001
2015-02-12 14:45:45,298 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:45,301 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000001 by user soberoi
2015-02-12 14:45:45,302 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0011
2015-02-12 14:45:45,303 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000001
2015-02-12 14:45:45,303 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from NEW to INITING
2015-02-12 14:45:45,304 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000001 to application application_1423780884992_0011
2015-02-12 14:45:45,304 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from INITING to RUNNING
2015-02-12 14:45:45,304 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0011_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0011_000001
2015-02-12 14:45:45,304 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:45:45,304 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:45:45,304 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:45,304 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:45,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:45:45,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:45:45,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:45,305 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0011_01_000001
2015-02-12 14:45:45,322 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0011_01_000001.tokens. Credentials list:
2015-02-12 14:45:45,451 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:45,546 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0011_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000001.tokens
2015-02-12 14:45:45,546 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:45:45,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:45,676 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:45,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:45,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:45,719 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073741944_1120 to datanode(s) 127.0.0.1:50546
2015-02-12 14:45:45,719 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741936_1112, blk_1073741937_1113, blk_1073741939_1115, blk_1073741933_1109, blk_1073741934_1110, blk_1073741935_1111]
2015-02-12 14:45:45,719 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741936_1112, blk_1073741937_1113, blk_1073741938_1114, blk_1073741939_1115, blk_1073741933_1109, blk_1073741934_1110, blk_1073741935_1111]
2015-02-12 14:45:45,740 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:45,763 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:45,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:45,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:45:45,802 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:45,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:45,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:45,871 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:45,871 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:45,913 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:45,914 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:46,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000001/default_container_executor.sh]
2015-02-12 14:45:46,292 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:46,563 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 to 127.0.0.1:50546
2015-02-12 14:45:46,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 src: /127.0.0.1:51800 dest: /127.0.0.1:50546
2015-02-12 14:45:46,565 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:45:46,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120 src: /127.0.0.1:51800 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:45:46,567 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741944_1120 size 254067
2015-02-12 14:45:46,769 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:46,936 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741936_1112 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741936 for deletion
2015-02-12 14:45:46,936 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741937_1113 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741937 for deletion
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741939 for deletion
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933 for deletion
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741936_1112 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741936
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934 for deletion
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741935 for deletion
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741939
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741937_1113 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741937
2015-02-12 14:45:46,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934
2015-02-12 14:45:46,938 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933
2015-02-12 14:45:46,938 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741935
2015-02-12 14:45:47,200 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741936_1112 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741936 for deletion
2015-02-12 14:45:47,200 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741937_1113 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741937 for deletion
2015-02-12 14:45:47,200 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741938 for deletion
2015-02-12 14:45:47,200 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741936_1112 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741936
2015-02-12 14:45:47,201 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741938
2015-02-12 14:45:47,200 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741939 for deletion
2015-02-12 14:45:47,201 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741937_1113 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741937
2015-02-12 14:45:47,201 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933 for deletion
2015-02-12 14:45:47,201 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741939
2015-02-12 14:45:47,201 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934 for deletion
2015-02-12 14:45:47,202 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741935 for deletion
2015-02-12 14:45:47,202 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933
2015-02-12 14:45:47,202 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934
2015-02-12 14:45:47,202 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741935
2015-02-12 14:45:47,779 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:47,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:45:47,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:45:47,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:45:47,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:45:48,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011 dst=null perm=null proto=rpc
2015-02-12 14:45:48,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:45:48,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:45:48,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:48,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:45:48,729 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741937_1113, blk_1073741938_1114, blk_1073741933_1109, blk_1073741934_1110, blk_1073741935_1111]
2015-02-12 14:45:48,729 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741936_1112, blk_1073741938_1114, blk_1073741939_1115, blk_1073741933_1109, blk_1073741934_1110]
2015-02-12 14:45:48,786 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:49,273 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:49,275 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0011_000001
2015-02-12 14:45:49,276 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0011 APPATTEMPTID=appattempt_1423780884992_0011_000001
2015-02-12 14:45:49,276 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:45:49,276 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from ACCEPTED to RUNNING
2015-02-12 14:45:49,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:49,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:45:49,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:49,572 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741937_1113 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741937 for deletion
2015-02-12 14:45:49,572 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741936_1112 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741936 for deletion
2015-02-12 14:45:49,572 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741938 for deletion
2015-02-12 14:45:49,572 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741939 for deletion
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741937_1113 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741937
2015-02-12 14:45:49,572 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741938 for deletion
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933 for deletion
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934 for deletion
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741935 for deletion
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741936_1112 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741936
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933 for deletion
2015-02-12 14:45:49,574 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934 for deletion
2015-02-12 14:45:49,574 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741939
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741938
2015-02-12 14:45:49,573 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741938
2015-02-12 14:45:49,574 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933
2015-02-12 14:45:49,575 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741934
2015-02-12 14:45:49,575 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741935
2015-02-12 14:45:49,574 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741933
2015-02-12 14:45:49,712 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:45:49,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124 src: /127.0.0.1:51808 dest: /127.0.0.1:50539
2015-02-12 14:45:49,767 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124 src: /127.0.0.1:51809 dest: /127.0.0.1:50546
2015-02-12 14:45:49,769 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124 src: /127.0.0.1:51810 dest: /127.0.0.1:50543
2015-02-12 14:45:49,795 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:49,804 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51810, dest: /127.0.0.1:50543, bytes: 114535, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124, duration: 32805000
2015-02-12 14:45:49,805 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:49,807 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51809, dest: /127.0.0.1:50546, bytes: 114535, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124, duration: 35767000
2015-02-12 14:45:49,810 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:49,811 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:45:49,813 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51808, dest: /127.0.0.1:50539, bytes: 114535, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124, duration: 42086000
2015-02-12 14:45:49,814 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:49,815 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:45:49,816 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:45:49,830 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:45:49,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:45:49,864 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:45:49,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125 src: /127.0.0.1:51811 dest: /127.0.0.1:50539
2015-02-12 14:45:49,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125 src: /127.0.0.1:51812 dest: /127.0.0.1:50546
2015-02-12 14:45:49,870 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125 src: /127.0.0.1:51813 dest: /127.0.0.1:50543
2015-02-12 14:45:49,886 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51813, dest: /127.0.0.1:50543, bytes: 403, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125, duration: 13849000
2015-02-12 14:45:49,886 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:45:49,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:49,887 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51812, dest: /127.0.0.1:50546, bytes: 403, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125, duration: 14766000
2015-02-12 14:45:49,887 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:49,890 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51811, dest: /127.0.0.1:50539, bytes: 403, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125, duration: 16216000
2015-02-12 14:45:49,890 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:45:49,890 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:49,891 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:45:49,895 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011.summary is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:45:50,158 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0010_01_000001 succeeded
2015-02-12 14:45:50,158 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:45:50,158 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0010_01_000001
2015-02-12 14:45:50,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000001
2015-02-12 14:45:50,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000001
2015-02-12 14:45:50,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000001
2015-02-12 14:45:50,174 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000001
2015-02-12 14:45:50,174 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0010/container_1423780884992_0010_01_000001
2015-02-12 14:45:50,174 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0010_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:45:50,174 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0010_01_000001 from application application_1423780884992_0010
2015-02-12 14:45:50,174 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:50,174 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0010
2015-02-12 14:45:50,319 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0010_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:45:50,319 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0010_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:45:50,319 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0010_000001
2015-02-12 14:45:50,319 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0010_000001
2015-02-12 14:45:50,319 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0010_000001 State change from FINISHING to FINISHED
2015-02-12 14:45:50,319 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0010 State change from FINISHING to FINISHED
2015-02-12 14:45:50,319 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000001
2015-02-12 14:45:50,320 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:45:50,320 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0010_000001 released container container_1423780884992_0010_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:45:50,320 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0010
2015-02-12 14:45:50,320 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0010,name=[5A65BCDD601C450BB697A96C6B6209A1/9705897B722B4BFC942904C4B8BC7C62] lower*upper1*upper2/(2/2),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0010/jobhistory/job/job_1423780884992_0010,appMasterHost=10.1.1.67,startTime=1423781119355,finishTime=1423781143997,finalStatus=SUCCEEDED
2015-02-12 14:45:50,320 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:50,320 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000002
2015-02-12 14:45:50,320 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:45:50,321 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0010_000001 is done. finalState=FINISHED
2015-02-12 14:45:50,321 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0010 requests cleared
2015-02-12 14:45:50,320 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0010_000001
2015-02-12 14:45:50,323 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0010_000001 (auth:SIMPLE)
2015-02-12 14:45:50,325 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0010_01_000001
2015-02-12 14:45:50,325 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0010 CONTAINERID=container_1423780884992_0010_01_000001
2015-02-12 14:45:50,325 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0010_01_000001]
2015-02-12 14:45:50,325 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:50,325 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:50,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:50,326 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000003
2015-02-12 14:45:50,326 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,326 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:45:50,326 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,326 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,327 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0010
2015-02-12 14:45:50,327 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,327 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:50,327 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0010, with delay of 10800 seconds
2015-02-12 14:45:50,797 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:50,797 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:50,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:50,798 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000004
2015-02-12 14:45:50,798 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,798 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:50,799 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0010
2015-02-12 14:45:50,799 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,799 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:50,800 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0010, with delay of 10800 seconds
2015-02-12 14:45:50,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,923 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:50,923 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:50,923 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000005
2015-02-12 14:45:50,924 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:50,924 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,926 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0010
2015-02-12 14:45:50,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:50,927 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:50,927 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0010, with delay of 10800 seconds
2015-02-12 14:45:50,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:51,089 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:45:51,089 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:51,089 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000006
2015-02-12 14:45:51,089 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:45:51,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:51,090 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0010
2015-02-12 14:45:51,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:51,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:51,091 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:45:51,092 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0010, with delay of 10800 seconds
2015-02-12 14:45:51,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0010
2015-02-12 14:45:51,330 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0011
2015-02-12 14:45:51,331 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:45:51,331 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0011_01_000007 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3199f944
2015-02-12 14:45:51,332 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0011_01_000002
2015-02-12 14:45:51,332 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:51,332 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:51,333 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0011_01_000004
2015-02-12 14:45:51,333 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:51,333 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0011_01_000005
2015-02-12 14:45:51,334 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:51,334 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0011_01_000006
2015-02-12 14:45:51,334 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:51,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:51,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:51,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:45:51,482 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:51,482 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:51,482 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:51,484 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:51,482 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:51,487 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000004 by user soberoi
2015-02-12 14:45:51,487 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0011
2015-02-12 14:45:51,487 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000004
2015-02-12 14:45:51,487 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from NEW to INITING
2015-02-12 14:45:51,488 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000004 to application application_1423780884992_0011
2015-02-12 14:45:51,488 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from INITING to RUNNING
2015-02-12 14:45:51,488 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:45:51,488 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,489 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,489 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:51,489 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:45:51,489 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:51,489 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:51,489 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0011_01_000004
2015-02-12 14:45:51,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000006 by user soberoi
2015-02-12 14:45:51,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0011
2015-02-12 14:45:51,490 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000006
2015-02-12 14:45:51,492 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from NEW to INITING
2015-02-12 14:45:51,492 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000006 to application application_1423780884992_0011
2015-02-12 14:45:51,492 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from INITING to RUNNING
2015-02-12 14:45:51,492 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:45:51,492 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,492 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,492 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:51,492 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:45:51,493 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:51,493 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:51,493 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0011_01_000006
2015-02-12 14:45:51,494 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000005 by user soberoi
2015-02-12 14:45:51,495 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0011
2015-02-12 14:45:51,495 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000005
2015-02-12 14:45:51,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000003 by user soberoi
2015-02-12 14:45:51,496 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000003
2015-02-12 14:45:51,498 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000002 by user soberoi
2015-02-12 14:45:51,498 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000003 to application application_1423780884992_0011
2015-02-12 14:45:51,498 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000002
2015-02-12 14:45:51,498 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:45:51,498 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000002 to application application_1423780884992_0011
2015-02-12 14:45:51,498 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,498 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,499 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:51,499 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:45:51,499 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:45:51,498 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from NEW to INITING
2015-02-12 14:45:51,500 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:51,500 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,500 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,500 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:51,500 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:45:51,500 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000005 to application application_1423780884992_0011
2015-02-12 14:45:51,501 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:51,501 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from INITING to RUNNING
2015-02-12 14:45:51,501 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:45:51,503 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,503 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:45:51,503 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:51,503 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:45:51,504 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:45:51,504 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:45:51,504 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0011_01_000005
2015-02-12 14:45:51,528 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0011_01_000006.tokens. Credentials list:
2015-02-12 14:45:51,530 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0011_01_000004.tokens. Credentials list:
2015-02-12 14:45:51,543 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0011_01_000005.tokens. Credentials list:
2015-02-12 14:45:51,592 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:51,592 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:51,601 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:51,601 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:51,797 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:51,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:51,798 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:45:51,799 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:51,800 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000008
2015-02-12 14:45:51,800 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:45:51,801 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:51,812 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:51,867 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000003/default_container_executor.sh]
2015-02-12 14:45:51,877 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000002/default_container_executor.sh]
2015-02-12 14:45:51,926 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:52,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117
2015-02-12 14:45:52,001 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121
2015-02-12 14:45:52,004 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120
2015-02-12 14:45:52,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0011_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000004.tokens
2015-02-12 14:45:52,051 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:45:52,083 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0011_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000005.tokens
2015-02-12 14:45:52,083 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0011_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000006.tokens
2015-02-12 14:45:52,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:45:52,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:45:52,090 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:52,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:52,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:52,206 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123
2015-02-12 14:45:52,208 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119
2015-02-12 14:45:52,208 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122
2015-02-12 14:45:52,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:52,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:52,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:52,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar dst=null perm=null proto=rpc
2015-02-12 14:45:52,291 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:52,303 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0011/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:52,323 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0011/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:52,339 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:52,339 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:52,339 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0011_000001 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096
2015-02-12 14:45:52,339 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0011 unreserved on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:45:52,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:52,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:52,355 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:52,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:52,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:52,371 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:45:52,374 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000008 by user soberoi
2015-02-12 14:45:52,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:52,375 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000008
2015-02-12 14:45:52,376 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000008 to application application_1423780884992_0011
2015-02-12 14:45:52,377 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:45:52,378 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:45:52,378 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:45:52,378 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:45:52,378 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:45:52,378 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0011_01_000008
2015-02-12 14:45:52,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml dst=null perm=null proto=rpc
2015-02-12 14:45:52,402 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0011_01_000008.tokens. Credentials list:
2015-02-12 14:45:52,441 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:52,441 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:52,441 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:52,458 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0011/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:52,459 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:52,467 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:45:52,468 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:45:52,508 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:52,509 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:52,509 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:52,510 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:52,519 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:52,519 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:52,529 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:45:52,530 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:45:52,539 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117
2015-02-12 14:45:52,542 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120
2015-02-12 14:45:52,743 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118
2015-02-12 14:45:52,744 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116
2015-02-12 14:45:52,744 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121
2015-02-12 14:45:52,745 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119
2015-02-12 14:45:52,801 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:45:52,801 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:45:52,801 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000009
2015-02-12 14:45:52,801 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:45:52,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000005/default_container_executor.sh]
2015-02-12 14:45:52,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000006/default_container_executor.sh]
2015-02-12 14:45:52,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000004/default_container_executor.sh]
2015-02-12 14:45:52,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000008/default_container_executor.sh]
2015-02-12 14:45:52,868 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741943_1119
2015-02-12 14:45:52,943 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123
2015-02-12 14:45:52,943 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122
2015-02-12 14:45:52,976 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120
2015-02-12 14:45:52,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121
2015-02-12 14:45:52,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116
2015-02-12 14:45:52,978 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118
2015-02-12 14:45:52,979 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741947_1123
2015-02-12 14:45:53,069 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741944_1120
2015-02-12 14:45:53,069 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741941_1117
2015-02-12 14:45:53,070 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741946_1122
2015-02-12 14:45:53,070 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741940_1116
2015-02-12 14:45:53,071 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741945_1121
2015-02-12 14:45:53,074 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741942_1118
2015-02-12 14:45:53,367 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:45:53,367 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:45:53,486 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:45:53,627 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0011_01_000008.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000008.tokens
2015-02-12 14:45:53,627 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:45:54,376 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:45:54,376 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:45:54,376 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000009
2015-02-12 14:45:54,376 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:45:54,377 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000009 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:45:54,807 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0011_01_000009
2015-02-12 14:45:57,212 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125
2015-02-12 14:45:57,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124
2015-02-12 14:45:57,951 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124
2015-02-12 14:45:57,951 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125
2015-02-12 14:45:57,992 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741949_1125
2015-02-12 14:45:57,993 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741948_1124
2015-02-12 14:46:02,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:02,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:02,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:02,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:02,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:02,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:02,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:02,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:03,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:03,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:03,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:03,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:03,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:03,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:03,682 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:03,684 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000002
2015-02-12 14:46:03,684 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000002
2015-02-12 14:46:03,684 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:46:03,684 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000002
2015-02-12 14:46:03,705 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000002 is : 143
2015-02-12 14:46:03,711 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:46:03,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126 src: /127.0.0.1:51854 dest: /127.0.0.1:50543
2015-02-12 14:46:03,715 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:03,719 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126 src: /127.0.0.1:51855 dest: /127.0.0.1:50549
2015-02-12 14:46:03,719 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000002
2015-02-12 14:46:03,720 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000002
2015-02-12 14:46:03,720 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000002
2015-02-12 14:46:03,720 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000002
2015-02-12 14:46:03,720 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000002
2015-02-12 14:46:03,720 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:03,721 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000002 from application application_1423780884992_0011
2015-02-12 14:46:03,721 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:03,721 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:03,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126 src: /127.0.0.1:51856 dest: /127.0.0.1:50546
2015-02-12 14:46:03,729 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist for DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:03,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:46:03,841 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:03,843 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000003
2015-02-12 14:46:03,843 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000003
2015-02-12 14:46:03,843 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:46:03,844 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000003
2015-02-12 14:46:03,844 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:03,844 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:46:03,844 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000002
2015-02-12 14:46:03,845 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:46:03,845 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000002 on node: host: 10.1.1.67:50575 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:46:03,894 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000003 is : 143
2015-02-12 14:46:03,910 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:03,911 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000003
2015-02-12 14:46:03,911 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000003
2015-02-12 14:46:03,912 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000003
2015-02-12 14:46:03,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000003
2015-02-12 14:46:03,914 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000003
2015-02-12 14:46:03,914 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:03,914 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000003 from application application_1423780884992_0011
2015-02-12 14:46:03,914 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:03,914 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:04,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:46:04,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:46:04,028 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:04,030 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000004
2015-02-12 14:46:04,030 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000004
2015-02-12 14:46:04,031 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:46:04,031 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000004
2015-02-12 14:46:04,035 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:04,037 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000006
2015-02-12 14:46:04,037 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000006
2015-02-12 14:46:04,037 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:46:04,037 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000006
2015-02-12 14:46:04,052 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000004 is : 143
2015-02-12 14:46:04,063 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:04,066 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000004
2015-02-12 14:46:04,066 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:04,066 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000004 from application application_1423780884992_0011
2015-02-12 14:46:04,066 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:04,066 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:04,066 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000004
2015-02-12 14:46:04,068 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000004
2015-02-12 14:46:04,068 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000004
2015-02-12 14:46:04,068 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000004
2015-02-12 14:46:04,070 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000006 is : 143
2015-02-12 14:46:04,073 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:04,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000006
2015-02-12 14:46:04,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000006
2015-02-12 14:46:04,074 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000006
2015-02-12 14:46:04,074 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:04,075 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000006 from application application_1423780884992_0011
2015-02-12 14:46:04,075 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:04,075 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000006
2015-02-12 14:46:04,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000006
2015-02-12 14:46:04,075 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:04,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:46:04,133 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:04,135 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000008
2015-02-12 14:46:04,136 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000008
2015-02-12 14:46:04,136 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:46:04,136 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000008
2015-02-12 14:46:04,138 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:04,139 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:46:04,139 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000004
2015-02-12 14:46:04,140 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:46:04,140 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000004 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:46:04,161 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000008 is : 143
2015-02-12 14:46:04,177 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:04,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000008
2015-02-12 14:46:04,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000008
2015-02-12 14:46:04,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000008
2015-02-12 14:46:04,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000008
2015-02-12 14:46:04,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000008
2015-02-12 14:46:04,183 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:04,184 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000008 from application application_1423780884992_0011
2015-02-12 14:46:04,185 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:04,185 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:04,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:46:04,300 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:04,302 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000005
2015-02-12 14:46:04,303 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000005
2015-02-12 14:46:04,303 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:46:04,303 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000005
2015-02-12 14:46:04,323 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000005 is : 143
2015-02-12 14:46:04,335 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:04,336 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000005
2015-02-12 14:46:04,336 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000005
2015-02-12 14:46:04,336 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000005
2015-02-12 14:46:04,337 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000005
2015-02-12 14:46:04,337 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000005
2015-02-12 14:46:04,337 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:04,337 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000005 from application application_1423780884992_0011
2015-02-12 14:46:04,337 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:04,337 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:04,855 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:04,855 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:04,856 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:46:04,856 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000003
2015-02-12 14:46:04,856 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:46:04,856 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000003 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:46:05,042 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:05,042 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:46:05,043 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000006
2015-02-12 14:46:05,043 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:05,043 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000006 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:05,146 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:05,147 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:05,147 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:46:05,147 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000008
2015-02-12 14:46:05,147 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:05,148 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000008 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:05,310 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:05,310 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:46:05,310 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000005
2015-02-12 14:46:05,310 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:05,310 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000005 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:05,861 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000002]
2015-02-12 14:46:05,861 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:05,861 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:05,862 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:05,862 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000010
2015-02-12 14:46:05,862 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0011_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:46:06,046 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:06,155 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000004]
2015-02-12 14:46:06,156 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:06,156 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:06,318 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:06,463 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:06,474 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:06,476 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0011_01_000010 by user soberoi
2015-02-12 14:46:06,477 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000010
2015-02-12 14:46:06,477 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0011_01_000010 to application application_1423780884992_0011
2015-02-12 14:46:06,477 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 14:46:06,477 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0011
2015-02-12 14:46:06,477 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0011
2015-02-12 14:46:06,478 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:06,478 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0011
2015-02-12 14:46:06,478 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:06,509 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:06,509 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:06,618 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000010/default_container_executor.sh]
2015-02-12 14:46:06,868 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000003]
2015-02-12 14:46:06,868 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:06,868 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:07,051 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000006]
2015-02-12 14:46:07,051 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:07,162 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000008]
2015-02-12 14:46:07,164 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:07,324 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000005]
2015-02-12 14:46:07,324 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:07,472 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:46:09,090 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:09,093 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:09,096 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:09,097 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:09,110 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:09,113 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:09,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,390 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:46:09,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127 src: /127.0.0.1:51872 dest: /127.0.0.1:50549
2015-02-12 14:46:09,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127 src: /127.0.0.1:51873 dest: /127.0.0.1:50546
2015-02-12 14:46:09,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127 src: /127.0.0.1:51874 dest: /127.0.0.1:50539
2015-02-12 14:46:09,528 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51874, dest: /127.0.0.1:50539, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0011_r_000000_0_1079791991_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127, duration: 28340000
2015-02-12 14:46:09,528 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:09,529 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:46:09,529 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51873, dest: /127.0.0.1:50546, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0011_r_000000_0_1079791991_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127, duration: 28825000
2015-02-12 14:46:09,529 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,530 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:46:09,530 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51872, dest: /127.0.0.1:50549, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0011_r_000000_0_1079791991_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127, duration: 30024000
2015-02-12 14:46:09,531 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,532 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,548 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 14:46:09,549 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:46:09,555 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0011_r_000000_0_1079791991_1
2015-02-12 14:46:09,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:09,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:09,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/task_1423780884992_0011_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:46:09,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/_temporary/attempt_1423780884992_0011_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/task_1423780884992_0011_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:46:09,603 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:09,604 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000010
2015-02-12 14:46:09,605 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000010
2015-02-12 14:46:09,605 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000010 transitioned from RUNNING to KILLING
2015-02-12 14:46:09,605 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000010
2015-02-12 14:46:09,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,613 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,630 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0011_01_000010 is : 143
2015-02-12 14:46:09,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:46:09,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:09,651 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:09,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:09,652 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000010
2015-02-12 14:46:09,652 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000010
2015-02-12 14:46:09,652 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000010
2015-02-12 14:46:09,652 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:09,653 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000010 from application application_1423780884992_0011
2015-02-12 14:46:09,653 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:09,653 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:09,654 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000010
2015-02-12 14:46:09,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000010
2015-02-12 14:46:09,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/task_1423780884992_0011_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:46:09,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:09,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary/1/task_1423780884992_0011_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:46:09,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,677 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,682 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,702 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51856, dest: /127.0.0.1:50546, bytes: 76219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126, duration: 5978531000
2015-02-12 14:46:09,702 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:09,704 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:46:09,705 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51855, dest: /127.0.0.1:50549, bytes: 76219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126, duration: 5981125000
2015-02-12 14:46:09,705 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,707 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51854, dest: /127.0.0.1:50543, bytes: 76219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126, duration: 5983617000
2015-02-12 14:46:09,707 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,708 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:46:09,710 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:46:09,711 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,719 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:46:09,721 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128 src: /127.0.0.1:51876 dest: /127.0.0.1:50543
2015-02-12 14:46:09,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128 src: /127.0.0.1:51877 dest: /127.0.0.1:50539
2015-02-12 14:46:09,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128 src: /127.0.0.1:51878 dest: /127.0.0.1:50546
2015-02-12 14:46:09,726 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51878, dest: /127.0.0.1:50546, bytes: 463, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128, duration: 1395000
2015-02-12 14:46:09,727 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:09,727 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,727 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51877, dest: /127.0.0.1:50539, bytes: 463, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128, duration: 2149000
2015-02-12 14:46:09,728 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,728 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,728 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51876, dest: /127.0.0.1:50543, bytes: 463, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128, duration: 2954000
2015-02-12 14:46:09,728 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,729 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,730 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary_tmp is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:09,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:09,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:09,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:09,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:09,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:09,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,765 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:46:09,769 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129 src: /127.0.0.1:51880 dest: /127.0.0.1:50539
2015-02-12 14:46:09,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129 src: /127.0.0.1:51881 dest: /127.0.0.1:50543
2015-02-12 14:46:09,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129 src: /127.0.0.1:51882 dest: /127.0.0.1:50546
2015-02-12 14:46:09,775 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51882, dest: /127.0.0.1:50546, bytes: 76219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129, duration: 1939000
2015-02-12 14:46:09,775 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:09,776 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:46:09,776 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51881, dest: /127.0.0.1:50543, bytes: 76219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129, duration: 2915000
2015-02-12 14:46:09,776 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,777 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51880, dest: /127.0.0.1:50539, bytes: 76219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129, duration: 3983000
2015-02-12 14:46:09,778 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,778 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,779 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,782 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:09,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:09,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:09,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:09,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:09,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011/job_1423780884992_0011_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:09,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:09,805 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:46:09,808 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130 src: /127.0.0.1:51883 dest: /127.0.0.1:50546
2015-02-12 14:46:09,810 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130 src: /127.0.0.1:51884 dest: /127.0.0.1:50549
2015-02-12 14:46:09,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130 src: /127.0.0.1:51885 dest: /127.0.0.1:50543
2015-02-12 14:46:09,814 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51885, dest: /127.0.0.1:50543, bytes: 114535, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130, duration: 1771000
2015-02-12 14:46:09,815 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:09,815 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,815 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51884, dest: /127.0.0.1:50549, bytes: 114535, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130, duration: 2618000
2015-02-12 14:46:09,815 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,816 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,816 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51883, dest: /127.0.0.1:50546, bytes: 114535, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1597659692_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130, duration: 3671000
2015-02-12 14:46:09,817 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:09,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:09,820 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1597659692_1
2015-02-12 14:46:09,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:09,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:09,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:09,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:09,841 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0011_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:46:09,841 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:46:09,842 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0011 with final state: FINISHING
2015-02-12 14:46:09,842 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from RUNNING to FINAL_SAVING
2015-02-12 14:46:09,842 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0011
2015-02-12 14:46:09,842 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:46:09,843 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from FINAL_SAVING to FINISHING
2015-02-12 14:46:10,614 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:10,615 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 14:46:10,615 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000010
2015-02-12 14:46:10,615 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:46:10,616 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000010 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:46:10,851 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0011 unregistered successfully.
2015-02-12 14:46:10,867 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741944_1120 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:46:10,867 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741945_1121 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:46:10,867 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741946_1122 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:46:10,867 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741947_1123 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:46:10,868 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741949_1125 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:46:10,868 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741950_1126 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:46:10,868 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741948_1124 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:46:10,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0011 dst=null perm=null proto=rpc
2015-02-12 14:46:10,899 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741940_1116 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:46:10,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/9234379586_lower_upper1_423B80AA79BB44578A4AC408D225988E dst=null perm=null proto=rpc
2015-02-12 14:46:10,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,901 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary
2015-02-12 14:46:10,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:46:10,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,913 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:10,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:10,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,935 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:10,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:10,942 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup
2015-02-12 14:46:10,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup dst=null perm=null proto=rpc
2015-02-12 14:46:10,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:10,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupacogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:10,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:10,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:10,971 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:46:10,971 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:46:10,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:10,990 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:46:10,991 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:46:10,991 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:46:10,991 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter"]
2015-02-12 14:46:10,991 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:46:10,991 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:46:10,991 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:46:10,993 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...latform/cogroupinnerouter
2015-02-12 14:46:11,005 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:46:11,020 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:46:11,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:11,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:11,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:11,031 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 12
2015-02-12 14:46:11,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012 dst=null perm=null proto=rpc
2015-02-12 14:46:11,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:46:11,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:46:11,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,041 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:46:11,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 src: /127.0.0.1:51891 dest: /127.0.0.1:50543
2015-02-12 14:46:11,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 src: /127.0.0.1:51892 dest: /127.0.0.1:50539
2015-02-12 14:46:11,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 src: /127.0.0.1:51893 dest: /127.0.0.1:50546
2015-02-12 14:46:11,052 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51893, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131, duration: 2393000
2015-02-12 14:46:11,052 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:11,052 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:46:11,053 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51892, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131, duration: 3606000
2015-02-12 14:46:11,053 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,054 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51891, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131, duration: 4663000
2015-02-12 14:46:11,054 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,056 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:46:11,057 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:46:11,059 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:11,060 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar
2015-02-12 14:46:11,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:46:11,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:46:11,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:46:11,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:46:11,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:46:11,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,070 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:11,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,073 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:11,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,075 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:11,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,077 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:11,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:11,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,085 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split
2015-02-12 14:46:11,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:11,086 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:46:11,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132 src: /127.0.0.1:51894 dest: /127.0.0.1:50543
2015-02-12 14:46:11,090 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132 src: /127.0.0.1:51895 dest: /127.0.0.1:50549
2015-02-12 14:46:11,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132 src: /127.0.0.1:51896 dest: /127.0.0.1:50546
2015-02-12 14:46:11,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132 src: /127.0.0.1:51897 dest: /127.0.0.1:50539
2015-02-12 14:46:11,099 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51897, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, duration: 1838000
2015-02-12 14:46:11,100 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:11,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,100 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51896, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, duration: 2770000
2015-02-12 14:46:11,101 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,102 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,102 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51895, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, duration: 3680000
2015-02-12 14:46:11,104 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,106 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51894, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, duration: 8078000
2015-02-12 14:46:11,106 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,107 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,111 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:11,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,116 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:46:11,119 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133 src: /127.0.0.1:51898 dest: /127.0.0.1:50539
2015-02-12 14:46:11,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133 src: /127.0.0.1:51899 dest: /127.0.0.1:50549
2015-02-12 14:46:11,123 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133 src: /127.0.0.1:51900 dest: /127.0.0.1:50543
2015-02-12 14:46:11,126 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51900, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133, duration: 1333000
2015-02-12 14:46:11,126 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:11,127 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:46:11,127 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51899, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133, duration: 1881000
2015-02-12 14:46:11,127 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,127 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:46:11,128 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51898, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133, duration: 2905000
2015-02-12 14:46:11,128 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,129 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,130 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:11,131 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:46:11,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:11,141 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:46:11,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134 src: /127.0.0.1:51901 dest: /127.0.0.1:50543
2015-02-12 14:46:11,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134 src: /127.0.0.1:51902 dest: /127.0.0.1:50549
2015-02-12 14:46:11,149 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134 src: /127.0.0.1:51903 dest: /127.0.0.1:50539
2015-02-12 14:46:11,152 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51903, dest: /127.0.0.1:50539, bytes: 97931, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134, duration: 1665000
2015-02-12 14:46:11,152 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:11,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,153 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51902, dest: /127.0.0.1:50549, bytes: 97931, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134, duration: 2380000
2015-02-12 14:46:11,154 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,157 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51901, dest: /127.0.0.1:50543, bytes: 97931, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134, duration: 6005000
2015-02-12 14:46:11,158 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:11,157 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,160 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:11,162 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:11,162 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0012
2015-02-12 14:46:11,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012 dst=null perm=null proto=rpc
2015-02-12 14:46:11,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:11,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:11,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:11,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:11,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:11,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:11,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,184 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 12 submitted by user soberoi
2015-02-12 14:46:11,184 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0012
2015-02-12 14:46:11,184 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from NEW to NEW_SAVING
2015-02-12 14:46:11,184 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0012
2015-02-12 14:46:11,184 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0012
2015-02-12 14:46:11,184 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:46:11,185 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0012 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:46:11,185 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from SUBMITTED to ACCEPTED
2015-02-12 14:46:11,185 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0012_000001
2015-02-12 14:46:11,185 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from NEW to SUBMITTED
2015-02-12 14:46:11,186 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0012_000001 to scheduler from user: soberoi
2015-02-12 14:46:11,187 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:46:11,187 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0012
2015-02-12 14:46:11,189 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0012/
2015-02-12 14:46:11,189 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0012
2015-02-12 14:46:11,189 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0012/
2015-02-12 14:46:11,352 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:11,352 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000001
2015-02-12 14:46:11,352 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:46:11,353 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0012_01_000001
2015-02-12 14:46:11,353 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:11,354 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0012_000001
2015-02-12 14:46:11,354 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0012 AttemptId: appattempt_1423780884992_0012_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0012_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:46:11,354 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:46:11,354 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:46:11,355 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0012_000001
2015-02-12 14:46:11,356 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0012_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0012_000001
2015-02-12 14:46:11,356 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0012_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:46:11,356 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0012_000001
2015-02-12 14:46:11,356 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0012_000001
2015-02-12 14:46:11,358 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:11,360 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000001 by user soberoi
2015-02-12 14:46:11,360 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0012
2015-02-12 14:46:11,361 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000001
2015-02-12 14:46:11,361 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from NEW to INITING
2015-02-12 14:46:11,361 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000001 to application application_1423780884992_0012
2015-02-12 14:46:11,361 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from INITING to RUNNING
2015-02-12 14:46:11,361 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0012_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0012_000001
2015-02-12 14:46:11,361 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:46:11,361 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:46:11,362 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:11,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:11,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:46:11,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:46:11,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:11,363 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0012_01_000001
2015-02-12 14:46:11,372 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0012_01_000001.tokens. Credentials list:
2015-02-12 14:46:11,493 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:11,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0012_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000001.tokens
2015-02-12 14:46:11,588 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:11,622 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:11,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:11,741 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0012/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:11,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:11,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:11,805 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:11,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:11,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:11,862 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:11,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:11,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:11,926 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0012/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:11,926 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:11,976 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:11,976 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:12,080 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000001/default_container_executor.sh]
2015-02-12 14:46:12,355 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:12,627 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:12,762 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073741955_1131 to datanode(s) 127.0.0.1:50549
2015-02-12 14:46:12,762 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741944_1120, blk_1073741945_1121, blk_1073741946_1122, blk_1073741947_1123, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126]
2015-02-12 14:46:12,762 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741940_1116, blk_1073741944_1120, blk_1073741945_1121, blk_1073741946_1122, blk_1073741950_1126]
2015-02-12 14:46:13,615 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741946_1122 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741946 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741947_1123 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741947 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741948 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741949 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741950 for deletion
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741946_1122 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741946
2015-02-12 14:46:13,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945
2015-02-12 14:46:13,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741948
2015-02-12 14:46:13,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741947_1123 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741947
2015-02-12 14:46:13,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741950
2015-02-12 14:46:13,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741949
2015-02-12 14:46:13,637 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:13,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:13,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:46:13,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:46:13,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:46:13,985 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 to 127.0.0.1:50549
2015-02-12 14:46:13,986 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 src: /127.0.0.1:51908 dest: /127.0.0.1:50549
2015-02-12 14:46:13,987 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:46:13,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131 src: /127.0.0.1:51908 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:46:13,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741955_1131 size 254067
2015-02-12 14:46:14,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012 dst=null perm=null proto=rpc
2015-02-12 14:46:14,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:46:14,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741940 for deletion
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944 for deletion
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945 for deletion
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741940
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741946_1122 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741946 for deletion
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741950 for deletion
2015-02-12 14:46:14,237 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944
2015-02-12 14:46:14,238 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741946_1122 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741946
2015-02-12 14:46:14,238 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945
2015-02-12 14:46:14,238 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741950
2015-02-12 14:46:14,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:14,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:14,645 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:15,381 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:15,383 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0012_000001
2015-02-12 14:46:15,383 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0012 APPATTEMPTID=appattempt_1423780884992_0012_000001
2015-02-12 14:46:15,383 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:46:15,383 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from ACCEPTED to RUNNING
2015-02-12 14:46:15,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:15,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:46:15,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:15,653 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:15,769 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741940_1116, blk_1073741944_1120, blk_1073741945_1121, blk_1073741947_1123, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126]
2015-02-12 14:46:15,769 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741940_1116, blk_1073741944_1120, blk_1073741945_1121, blk_1073741946_1122, blk_1073741947_1123, blk_1073741948_1124, blk_1073741949_1125]
2015-02-12 14:46:15,813 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:46:15,871 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135 src: /127.0.0.1:51915 dest: /127.0.0.1:50546
2015-02-12 14:46:15,873 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135 src: /127.0.0.1:51916 dest: /127.0.0.1:50549
2015-02-12 14:46:15,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135 src: /127.0.0.1:51917 dest: /127.0.0.1:50543
2015-02-12 14:46:15,915 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51917, dest: /127.0.0.1:50543, bytes: 114646, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135, duration: 37933000
2015-02-12 14:46:15,916 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:15,916 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:15,916 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51916, dest: /127.0.0.1:50549, bytes: 114646, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135, duration: 38784000
2015-02-12 14:46:15,917 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:15,918 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:15,918 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51915, dest: /127.0.0.1:50546, bytes: 114646, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135, duration: 40335000
2015-02-12 14:46:15,918 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:15,919 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:15,941 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0011_01_000001 succeeded
2015-02-12 14:46:15,941 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:46:15,941 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:15,941 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0011_01_000001
2015-02-12 14:46:15,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000001
2015-02-12 14:46:15,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000001
2015-02-12 14:46:15,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000001
2015-02-12 14:46:15,968 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000001
2015-02-12 14:46:15,968 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0011_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:46:15,969 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0011_01_000001 from application application_1423780884992_0011
2015-02-12 14:46:15,969 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:15,969 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0011
2015-02-12 14:46:15,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011/container_1423780884992_0011_01_000001
2015-02-12 14:46:15,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:15,985 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:46:15,987 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136 src: /127.0.0.1:51918 dest: /127.0.0.1:50539
2015-02-12 14:46:15,989 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136 src: /127.0.0.1:51919 dest: /127.0.0.1:50543
2015-02-12 14:46:15,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136 src: /127.0.0.1:51920 dest: /127.0.0.1:50549
2015-02-12 14:46:15,993 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51920, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136, duration: 1514000
2015-02-12 14:46:15,993 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:15,994 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51919, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136, duration: 2167000
2015-02-12 14:46:15,994 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:15,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:15,995 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51918, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136, duration: 3452000
2015-02-12 14:46:15,995 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:15,997 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:15,998 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:16,000 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012.summary is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:16,615 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741940 for deletion
2015-02-12 14:46:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944 for deletion
2015-02-12 14:46:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945 for deletion
2015-02-12 14:46:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741940
2015-02-12 14:46:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741946_1122 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741946 for deletion
2015-02-12 14:46:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741947_1123 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741947 for deletion
2015-02-12 14:46:16,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945
2015-02-12 14:46:16,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944
2015-02-12 14:46:16,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741948 for deletion
2015-02-12 14:46:16,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741949 for deletion
2015-02-12 14:46:16,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741947_1123 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741947
2015-02-12 14:46:16,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741946_1122 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741946
2015-02-12 14:46:16,618 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741949
2015-02-12 14:46:16,618 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741948
2015-02-12 14:46:16,662 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0011_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:16,662 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0011_000001
2015-02-12 14:46:16,662 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0011_000001
2015-02-12 14:46:16,662 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0011_000001 State change from FINISHING to FINISHED
2015-02-12 14:46:16,662 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0011 State change from FINISHING to FINISHED
2015-02-12 14:46:16,662 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0011_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:46:16,662 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0011
2015-02-12 14:46:16,663 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0011,name=[5A65BCDD601C450BB697A96C6B6209A1/E2B7991778BA4551B6D54A4047BDC05A] lower*upper1*upper2/(1/2) ...splatform/cogroupacogroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0011/jobhistory/job/job_1423780884992_0011,appMasterHost=10.1.1.67,startTime=1423781145276,finishTime=1423781169842,finalStatus=SUCCEEDED
2015-02-12 14:46:16,662 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000001
2015-02-12 14:46:16,663 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:16,663 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0011_000001 released container container_1423780884992_0011_01_000001 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:16,663 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:16,663 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0011_000001
2015-02-12 14:46:16,663 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:16,664 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000002
2015-02-12 14:46:16,664 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:16,664 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0011_000001 is done. finalState=FINISHED
2015-02-12 14:46:16,664 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0011 requests cleared
2015-02-12 14:46:16,666 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0011_000001 (auth:SIMPLE)
2015-02-12 14:46:16,668 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0011_01_000001
2015-02-12 14:46:16,668 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0011 CONTAINERID=container_1423780884992_0011_01_000001
2015-02-12 14:46:16,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0011_01_000001]
2015-02-12 14:46:16,668 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:16,669 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:16,669 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:16,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:16,669 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:16,669 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000003
2015-02-12 14:46:16,669 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:46:16,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:16,670 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:16,670 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0011
2015-02-12 14:46:16,670 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:16,670 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0011, with delay of 10800 seconds
2015-02-12 14:46:16,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:16,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741940 for deletion
2015-02-12 14:46:16,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944 for deletion
2015-02-12 14:46:16,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945 for deletion
2015-02-12 14:46:16,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741940
2015-02-12 14:46:16,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741947_1123 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741947 for deletion
2015-02-12 14:46:16,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741948 for deletion
2015-02-12 14:46:16,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741947_1123 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741947
2015-02-12 14:46:16,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741949 for deletion
2015-02-12 14:46:16,990 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741950 for deletion
2015-02-12 14:46:16,990 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741948
2015-02-12 14:46:16,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741944_1120 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741944
2015-02-12 14:46:16,990 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741950
2015-02-12 14:46:16,990 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741945
2015-02-12 14:46:16,991 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741949
2015-02-12 14:46:17,133 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:17,133 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:17,134 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000004
2015-02-12 14:46:17,134 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:17,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,135 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0011
2015-02-12 14:46:17,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,136 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:17,137 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0011, with delay of 10800 seconds
2015-02-12 14:46:17,219 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:17,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:17,220 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000005
2015-02-12 14:46:17,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,220 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:17,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,221 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0011
2015-02-12 14:46:17,222 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:17,222 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0011, with delay of 10800 seconds
2015-02-12 14:46:17,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,257 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134
2015-02-12 14:46:17,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132
2015-02-12 14:46:17,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128
2015-02-12 14:46:17,391 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:17,391 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:17,391 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000006
2015-02-12 14:46:17,392 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:46:17,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,393 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0011
2015-02-12 14:46:17,393 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,393 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:17,393 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0011, with delay of 10800 seconds
2015-02-12 14:46:17,393 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0011
2015-02-12 14:46:17,438 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0012_01_000002
2015-02-12 14:46:17,438 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:17,438 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:17,438 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0012_01_000004
2015-02-12 14:46:17,439 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:17,439 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0012_01_000005
2015-02-12 14:46:17,439 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:17,439 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0012_01_000006
2015-02-12 14:46:17,439 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:17,464 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131
2015-02-12 14:46:17,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133
2015-02-12 14:46:17,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129
2015-02-12 14:46:17,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:17,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:17,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:17,597 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:17,599 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:17,600 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:17,599 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:17,604 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:17,606 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000006 by user soberoi
2015-02-12 14:46:17,606 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000006
2015-02-12 14:46:17,606 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000002 by user soberoi
2015-02-12 14:46:17,607 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000006 to application application_1423780884992_0012
2015-02-12 14:46:17,607 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:46:17,607 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,607 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,607 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0012
2015-02-12 14:46:17,608 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000002
2015-02-12 14:46:17,607 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:17,609 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0012
2015-02-12 14:46:17,611 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:17,609 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from NEW to INITING
2015-02-12 14:46:17,612 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000002 to application application_1423780884992_0012
2015-02-12 14:46:17,613 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from INITING to RUNNING
2015-02-12 14:46:17,613 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:46:17,613 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,613 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,614 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:17,614 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0012
2015-02-12 14:46:17,615 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:17,615 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:17,616 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000004 by user soberoi
2015-02-12 14:46:17,616 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0012_01_000002
2015-02-12 14:46:17,616 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0012
2015-02-12 14:46:17,616 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000004
2015-02-12 14:46:17,615 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000003 by user soberoi
2015-02-12 14:46:17,619 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000003
2015-02-12 14:46:17,617 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from NEW to INITING
2015-02-12 14:46:17,621 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000004 to application application_1423780884992_0012
2015-02-12 14:46:17,621 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from INITING to RUNNING
2015-02-12 14:46:17,622 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:46:17,622 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,622 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,622 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:17,622 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0012
2015-02-12 14:46:17,623 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:17,623 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:17,625 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0012_01_000004
2015-02-12 14:46:17,615 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000005 by user soberoi
2015-02-12 14:46:17,625 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0012
2015-02-12 14:46:17,626 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000005
2015-02-12 14:46:17,622 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000003 to application application_1423780884992_0012
2015-02-12 14:46:17,630 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:46:17,630 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,630 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,630 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:17,630 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0012
2015-02-12 14:46:17,631 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0012_01_000003
2015-02-12 14:46:17,631 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from NEW to INITING
2015-02-12 14:46:17,631 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000005 to application application_1423780884992_0012
2015-02-12 14:46:17,631 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from INITING to RUNNING
2015-02-12 14:46:17,631 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:46:17,634 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,634 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0012
2015-02-12 14:46:17,634 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:17,634 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0012
2015-02-12 14:46:17,634 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:17,634 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:17,635 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0012_01_000005
2015-02-12 14:46:17,658 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0012_01_000002.tokens. Credentials list:
2015-02-12 14:46:17,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130
2015-02-12 14:46:17,677 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0012_01_000004.tokens. Credentials list:
2015-02-12 14:46:17,677 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:17,677 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:17,677 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:17,677 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0012_01_000005.tokens. Credentials list:
2015-02-12 14:46:17,678 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0012_01_000003.tokens. Credentials list:
2015-02-12 14:46:17,699 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:17,699 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:17,912 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:17,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:17,918 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:17,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000006/default_container_executor.sh]
2015-02-12 14:46:17,985 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131
2015-02-12 14:46:18,012 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132
2015-02-12 14:46:18,013 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131
2015-02-12 14:46:18,014 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128
2015-02-12 14:46:18,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132
2015-02-12 14:46:18,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133
2015-02-12 14:46:18,098 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127
2015-02-12 14:46:18,100 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130
2015-02-12 14:46:18,135 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:18,158 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0012_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000005.tokens
2015-02-12 14:46:18,158 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:18,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0012_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000002.tokens
2015-02-12 14:46:18,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:18,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0012_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000004.tokens
2015-02-12 14:46:18,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:18,186 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129
2015-02-12 14:46:18,187 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741957_1133
2015-02-12 14:46:18,188 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134
2015-02-12 14:46:18,188 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741956_1132
2015-02-12 14:46:18,189 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741952_1128
2015-02-12 14:46:18,189 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127
2015-02-12 14:46:18,215 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741953_1129
2015-02-12 14:46:18,216 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741954_1130
2015-02-12 14:46:18,217 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741951_1127
2015-02-12 14:46:18,221 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:18,302 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741958_1134
2015-02-12 14:46:18,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:18,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:18,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:18,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:18,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:18,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:18,394 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:18,414 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0012/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:18,421 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0012/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:18,422 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0012/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:18,451 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:46:18,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:18,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:18,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:18,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:18,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:18,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:18,528 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0012/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:18,528 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:18,535 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0012/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:18,535 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:18,552 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:18,552 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:18,553 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:18,585 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:18,585 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:18,600 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:18,600 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:18,622 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:18,622 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:18,623 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:18,623 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:18,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000004/default_container_executor.sh]
2015-02-12 14:46:18,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000005/default_container_executor.sh]
2015-02-12 14:46:18,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000003/default_container_executor.sh]
2015-02-12 14:46:18,858 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000002/default_container_executor.sh]
2015-02-12 14:46:19,588 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:19,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0012_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000003.tokens
2015-02-12 14:46:19,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:22,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136
2015-02-12 14:46:22,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135
2015-02-12 14:46:23,201 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136
2015-02-12 14:46:23,224 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135
2015-02-12 14:46:23,313 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741960_1136
2015-02-12 14:46:23,314 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741959_1135
2015-02-12 14:46:23,316 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741955_1131
2015-02-12 14:46:26,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:27,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:27,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:27,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:27,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:27,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:27,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:27,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:27,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:27,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:27,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:46:27,934 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:27,936 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000006
2015-02-12 14:46:27,936 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000006
2015-02-12 14:46:27,936 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:46:27,936 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000006
2015-02-12 14:46:27,963 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0012_01_000006 is : 143
2015-02-12 14:46:27,965 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:46:27,965 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 1082 Total time for transactions(ms): 107 Number of transactions batched in Syncs: 4 Number of syncs: 735 SyncTimes(ms): 255 169
2015-02-12 14:46:27,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137 src: /127.0.0.1:51971 dest: /127.0.0.1:50539
2015-02-12 14:46:27,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137 src: /127.0.0.1:51972 dest: /127.0.0.1:50546
2015-02-12 14:46:27,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137 src: /127.0.0.1:51973 dest: /127.0.0.1:50549
2015-02-12 14:46:27,978 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:27,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000006
2015-02-12 14:46:27,982 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000006
2015-02-12 14:46:27,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000006
2015-02-12 14:46:27,983 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:27,983 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000006 from application application_1423780884992_0012
2015-02-12 14:46:27,983 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:27,983 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:27,983 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000006
2015-02-12 14:46:27,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000006
2015-02-12 14:46:27,992 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist for DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:28,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:28,256 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:28,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:46:28,259 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000002
2015-02-12 14:46:28,259 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000002
2015-02-12 14:46:28,259 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:46:28,260 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000002
2015-02-12 14:46:28,284 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0012_01_000002 is : 143
2015-02-12 14:46:28,296 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:28,297 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000002
2015-02-12 14:46:28,297 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000002
2015-02-12 14:46:28,297 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000002
2015-02-12 14:46:28,297 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000002
2015-02-12 14:46:28,297 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:28,298 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000002 from application application_1423780884992_0012
2015-02-12 14:46:28,298 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:28,298 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:28,298 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000002
2015-02-12 14:46:28,313 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:28,315 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000003
2015-02-12 14:46:28,316 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000003
2015-02-12 14:46:28,316 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:46:28,316 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000003
2015-02-12 14:46:28,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:28,317 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:46:28,317 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000002
2015-02-12 14:46:28,319 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:46:28,319 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000002 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:46:28,347 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0012_01_000003 is : 143
2015-02-12 14:46:28,354 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:28,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000003
2015-02-12 14:46:28,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000003
2015-02-12 14:46:28,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000003
2015-02-12 14:46:28,356 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000003
2015-02-12 14:46:28,356 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:28,356 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000003 from application application_1423780884992_0012
2015-02-12 14:46:28,356 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:28,356 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:28,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000003
2015-02-12 14:46:28,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:46:28,443 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:28,445 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000004
2015-02-12 14:46:28,445 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000004
2015-02-12 14:46:28,445 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:46:28,445 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000004
2015-02-12 14:46:28,465 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0012_01_000004 is : 143
2015-02-12 14:46:28,475 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:28,476 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000004
2015-02-12 14:46:28,476 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000004
2015-02-12 14:46:28,477 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000004
2015-02-12 14:46:28,477 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000004
2015-02-12 14:46:28,477 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000004
2015-02-12 14:46:28,477 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:28,478 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000004 from application application_1423780884992_0012
2015-02-12 14:46:28,478 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:28,478 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:28,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:46:28,517 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:28,519 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000005
2015-02-12 14:46:28,519 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000005
2015-02-12 14:46:28,520 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:46:28,520 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000005
2015-02-12 14:46:28,540 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0012_01_000005 is : 143
2015-02-12 14:46:28,555 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:28,555 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000005
2015-02-12 14:46:28,557 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000005
2015-02-12 14:46:28,557 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000005
2015-02-12 14:46:28,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000005
2015-02-12 14:46:28,559 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000005
2015-02-12 14:46:28,559 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:28,559 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000005 from application application_1423780884992_0012
2015-02-12 14:46:28,560 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:28,561 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:28,945 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:28,946 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:46:28,946 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000006
2015-02-12 14:46:28,946 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:46:28,946 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000006 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:46:29,323 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:29,323 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:29,323 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:46:29,323 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000003
2015-02-12 14:46:29,324 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:29,324 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:29,455 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:29,455 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:46:29,455 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000004
2015-02-12 14:46:29,455 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:29,456 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:29,523 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:29,523 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:46:29,523 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000005
2015-02-12 14:46:29,523 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:29,524 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:29,954 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:29,955 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:29,955 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000007
2015-02-12 14:46:29,955 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0012_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:46:30,328 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0012_01_000002]
2015-02-12 14:46:30,329 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:30,329 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:30,464 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:30,530 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:30,544 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:30,554 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:30,556 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0012_01_000007 by user soberoi
2015-02-12 14:46:30,557 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000007
2015-02-12 14:46:30,557 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0012_01_000007 to application application_1423780884992_0012
2015-02-12 14:46:30,557 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:46:30,557 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0012
2015-02-12 14:46:30,557 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0012
2015-02-12 14:46:30,557 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:30,557 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0012
2015-02-12 14:46:30,558 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:30,592 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:30,592 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:30,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000007/default_container_executor.sh]
2015-02-12 14:46:30,962 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0012_01_000006]
2015-02-12 14:46:30,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:30,963 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:31,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0012_01_000003]
2015-02-12 14:46:31,333 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:31,466 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0012_01_000004]
2015-02-12 14:46:31,466 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:31,536 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0012_01_000005]
2015-02-12 14:46:31,536 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:31,551 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:46:33,094 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:33,099 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:33,101 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:33,104 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:33,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,439 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:46:33,532 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138 src: /127.0.0.1:51987 dest: /127.0.0.1:50539
2015-02-12 14:46:33,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138 src: /127.0.0.1:51988 dest: /127.0.0.1:50546
2015-02-12 14:46:33,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138 src: /127.0.0.1:51989 dest: /127.0.0.1:50549
2015-02-12 14:46:33,576 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51989, dest: /127.0.0.1:50549, bytes: 221, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0012_r_000000_0_67679254_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138, duration: 35136000
2015-02-12 14:46:33,577 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:33,577 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,577 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51988, dest: /127.0.0.1:50546, bytes: 221, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0012_r_000000_0_67679254_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138, duration: 35900000
2015-02-12 14:46:33,578 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,578 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51987, dest: /127.0.0.1:50539, bytes: 221, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0012_r_000000_0_67679254_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138, duration: 37001000
2015-02-12 14:46:33,578 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:33,579 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:33,586 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0012_r_000000_0_67679254_1
2015-02-12 14:46:33,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:33,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:33,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/task_1423780884992_0012_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:46:33,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/_temporary/attempt_1423780884992_0012_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/task_1423780884992_0012_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:46:33,642 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:33,644 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000007
2015-02-12 14:46:33,644 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000007
2015-02-12 14:46:33,645 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:46:33,645 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000007
2015-02-12 14:46:33,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,659 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:46:33,669 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0012_01_000007 is : 143
2015-02-12 14:46:33,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:33,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:33,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/task_1423780884992_0012_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:46:33,681 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:33,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:33,682 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000007
2015-02-12 14:46:33,683 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:33,683 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000007 from application application_1423780884992_0012
2015-02-12 14:46:33,683 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:33,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:33,683 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000007
2015-02-12 14:46:33,684 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000007
2015-02-12 14:46:33,684 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000007
2015-02-12 14:46:33,684 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000007
2015-02-12 14:46:33,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary/1/task_1423780884992_0012_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary dst=null perm=null proto=rpc
2015-02-12 14:46:33,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,699 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,703 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,723 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51973, dest: /127.0.0.1:50549, bytes: 69199, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137, duration: 5738769000
2015-02-12 14:46:33,723 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:33,724 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 16374
2015-02-12 14:46:33,724 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51972, dest: /127.0.0.1:50546, bytes: 69199, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137, duration: 5735739000
2015-02-12 14:46:33,725 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,726 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 16374
2015-02-12 14:46:33,727 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51971, dest: /127.0.0.1:50539, bytes: 69199, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137, duration: 5738284000
2015-02-12 14:46:33,728 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,729 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 16374
2015-02-12 14:46:33,730 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,735 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:46:33,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139 src: /127.0.0.1:51991 dest: /127.0.0.1:50543
2015-02-12 14:46:33,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139 src: /127.0.0.1:51992 dest: /127.0.0.1:50539
2015-02-12 14:46:33,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139 src: /127.0.0.1:51993 dest: /127.0.0.1:50549
2015-02-12 14:46:33,745 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51993, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139, duration: 2937000
2015-02-12 14:46:33,746 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:33,747 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51992, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139, duration: 2863000
2015-02-12 14:46:33,747 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,747 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,748 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51991, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139, duration: 5202000
2015-02-12 14:46:33,748 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,751 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741963_1139 size 455
2015-02-12 14:46:33,751 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,751 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741963_1139 size 455
2015-02-12 14:46:33,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:33,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:33,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:33,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:33,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:33,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:33,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,788 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:46:33,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140 src: /127.0.0.1:51995 dest: /127.0.0.1:50543
2015-02-12 14:46:33,792 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140 src: /127.0.0.1:51996 dest: /127.0.0.1:50549
2015-02-12 14:46:33,793 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140 src: /127.0.0.1:51997 dest: /127.0.0.1:50546
2015-02-12 14:46:33,797 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51997, dest: /127.0.0.1:50546, bytes: 69199, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140, duration: 2184000
2015-02-12 14:46:33,797 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:33,798 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,798 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51996, dest: /127.0.0.1:50549, bytes: 69199, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140, duration: 2685000
2015-02-12 14:46:33,798 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,799 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,799 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51995, dest: /127.0.0.1:50543, bytes: 69199, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140, duration: 4142000
2015-02-12 14:46:33,800 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,800 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,803 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:33,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:33,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:33,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:33,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:33,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012/job_1423780884992_0012_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:33,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:33,831 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:46:33,836 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141 src: /127.0.0.1:51999 dest: /127.0.0.1:50549
2015-02-12 14:46:33,838 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141 src: /127.0.0.1:52000 dest: /127.0.0.1:50546
2015-02-12 14:46:33,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141 src: /127.0.0.1:52001 dest: /127.0.0.1:50539
2015-02-12 14:46:33,843 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52001, dest: /127.0.0.1:50539, bytes: 114646, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141, duration: 2002000
2015-02-12 14:46:33,843 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:33,843 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,844 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52000, dest: /127.0.0.1:50546, bytes: 114646, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141, duration: 2547000
2015-02-12 14:46:33,844 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,845 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:51999, dest: /127.0.0.1:50549, bytes: 114646, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1805060473_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141, duration: 3578000
2015-02-12 14:46:33,845 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:33,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:46:33,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:33,848 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1805060473_1
2015-02-12 14:46:33,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:33,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:33,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:33,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:33,866 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0012_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:46:33,867 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:46:33,867 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0012 with final state: FINISHING
2015-02-12 14:46:33,867 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from RUNNING to FINAL_SAVING
2015-02-12 14:46:33,867 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0012
2015-02-12 14:46:33,868 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:46:33,868 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from FINAL_SAVING to FINISHING
2015-02-12 14:46:34,648 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:34,648 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:46:34,649 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000007
2015-02-12 14:46:34,649 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:46:34,649 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000007 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:46:34,880 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0012 unregistered successfully.
2015-02-12 14:46:34,884 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741955_1131 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:46:34,884 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741956_1132 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:46:34,885 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741957_1133 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:46:34,885 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741958_1134 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:46:34,885 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741960_1136 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:46:34,885 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741961_1137 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:46:34,885 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741959_1135 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:46:34,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0012 dst=null perm=null proto=rpc
2015-02-12 14:46:34,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,924 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary
2015-02-12 14:46:34,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/_temporary dst=null perm=null proto=rpc
2015-02-12 14:46:34,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,946 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:34,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:34,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:34,967 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:34,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:34,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:34,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:34,990 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:46:34,990 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:46:35,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:35,002 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:46:35,003 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:46:35,003 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:46:35,003 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup"]
2015-02-12 14:46:35,003 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:46:35,003 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:46:35,003 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:46:35,004 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...oupinnerouter-resultgroup
2015-02-12 14:46:35,017 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:46:35,034 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:46:35,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:35,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:35,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:35,041 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 13
2015-02-12 14:46:35,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013 dst=null perm=null proto=rpc
2015-02-12 14:46:35,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:46:35,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:46:35,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,054 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:46:35,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 src: /127.0.0.1:52006 dest: /127.0.0.1:50546
2015-02-12 14:46:35,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 src: /127.0.0.1:52007 dest: /127.0.0.1:50543
2015-02-12 14:46:35,061 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 src: /127.0.0.1:52008 dest: /127.0.0.1:50549
2015-02-12 14:46:35,065 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52008, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142, duration: 2127000
2015-02-12 14:46:35,066 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:35,067 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:35,068 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52007, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142, duration: 3773000
2015-02-12 14:46:35,068 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,069 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:35,070 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52006, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142, duration: 5987000
2015-02-12 14:46:35,070 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,073 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:35,074 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:35,075 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar
2015-02-12 14:46:35,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:46:35,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:46:35,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:46:35,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:46:35,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:46:35,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,091 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:35,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,095 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:35,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,099 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:35,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,103 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:35,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:35,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,109 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split
2015-02-12 14:46:35,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:35,111 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:46:35,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143 src: /127.0.0.1:52009 dest: /127.0.0.1:50543
2015-02-12 14:46:35,115 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143 src: /127.0.0.1:52010 dest: /127.0.0.1:50539
2015-02-12 14:46:35,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143 src: /127.0.0.1:52011 dest: /127.0.0.1:50546
2015-02-12 14:46:35,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143 src: /127.0.0.1:52012 dest: /127.0.0.1:50549
2015-02-12 14:46:35,122 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52012, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, duration: 1789000
2015-02-12 14:46:35,122 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:35,122 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,123 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52011, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, duration: 2307000
2015-02-12 14:46:35,123 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,124 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,124 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52010, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, duration: 3734000
2015-02-12 14:46:35,126 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,127 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,127 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52009, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, duration: 6915000
2015-02-12 14:46:35,128 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,134 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,137 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:35,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,157 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:46:35,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144 src: /127.0.0.1:52013 dest: /127.0.0.1:50546
2015-02-12 14:46:35,161 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144 src: /127.0.0.1:52014 dest: /127.0.0.1:50539
2015-02-12 14:46:35,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144 src: /127.0.0.1:52015 dest: /127.0.0.1:50543
2015-02-12 14:46:35,166 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52015, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144, duration: 1366000
2015-02-12 14:46:35,166 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:35,166 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,167 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52014, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144, duration: 1838000
2015-02-12 14:46:35,167 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,168 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,168 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52013, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144, duration: 2877000
2015-02-12 14:46:35,168 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,172 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,174 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:35,174 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:46:35,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:35,189 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:46:35,192 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145 src: /127.0.0.1:52016 dest: /127.0.0.1:50539
2015-02-12 14:46:35,194 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145 src: /127.0.0.1:52017 dest: /127.0.0.1:50546
2015-02-12 14:46:35,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145 src: /127.0.0.1:52018 dest: /127.0.0.1:50549
2015-02-12 14:46:35,201 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52018, dest: /127.0.0.1:50549, bytes: 97935, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145, duration: 1443000
2015-02-12 14:46:35,201 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:35,201 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:46:35,202 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52017, dest: /127.0.0.1:50546, bytes: 97935, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145, duration: 2113000
2015-02-12 14:46:35,202 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,202 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:35,203 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52016, dest: /127.0.0.1:50539, bytes: 97935, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145, duration: 2925000
2015-02-12 14:46:35,203 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:35,204 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:35,206 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:35,207 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0013
2015-02-12 14:46:35,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013 dst=null perm=null proto=rpc
2015-02-12 14:46:35,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:35,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:35,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:35,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:35,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:35,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:35,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,222 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 13 submitted by user soberoi
2015-02-12 14:46:35,222 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0013
2015-02-12 14:46:35,223 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from NEW to NEW_SAVING
2015-02-12 14:46:35,223 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0013
2015-02-12 14:46:35,223 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0013
2015-02-12 14:46:35,223 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:46:35,223 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0013 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:46:35,224 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from SUBMITTED to ACCEPTED
2015-02-12 14:46:35,224 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0013_000001
2015-02-12 14:46:35,224 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from NEW to SUBMITTED
2015-02-12 14:46:35,224 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0013_000001 to scheduler from user: soberoi
2015-02-12 14:46:35,224 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:46:35,225 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0013
2015-02-12 14:46:35,227 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0013/
2015-02-12 14:46:35,227 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0013
2015-02-12 14:46:35,227 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0013/
2015-02-12 14:46:35,353 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:35,353 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000001
2015-02-12 14:46:35,353 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:46:35,353 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0013_01_000001
2015-02-12 14:46:35,354 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:35,354 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0013_000001
2015-02-12 14:46:35,354 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0013 AttemptId: appattempt_1423780884992_0013_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0013_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:46:35,354 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:46:35,355 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:46:35,355 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0013_000001
2015-02-12 14:46:35,356 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0013_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0013_000001
2015-02-12 14:46:35,356 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0013_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:46:35,356 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0013_000001
2015-02-12 14:46:35,356 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0013_000001
2015-02-12 14:46:35,358 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:35,360 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000001 by user soberoi
2015-02-12 14:46:35,361 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0013
2015-02-12 14:46:35,361 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000001
2015-02-12 14:46:35,361 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from NEW to INITING
2015-02-12 14:46:35,361 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000001 to application application_1423780884992_0013
2015-02-12 14:46:35,361 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from INITING to RUNNING
2015-02-12 14:46:35,361 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0013_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0013_000001
2015-02-12 14:46:35,362 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:46:35,362 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:46:35,362 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:35,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:35,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:46:35,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:46:35,363 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:35,363 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0013_01_000001
2015-02-12 14:46:35,373 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0013_01_000001.tokens. Credentials list:
2015-02-12 14:46:35,491 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:35,584 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0013_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000001.tokens
2015-02-12 14:46:35,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:46:35,656 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:35,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:35,715 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:35,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:35,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:35,781 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0013/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:35,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:35,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:35,843 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0013/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:35,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:35,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:35,907 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0013/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:35,907 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:35,949 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:35,950 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:36,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000001/default_container_executor.sh]
2015-02-12 14:46:36,359 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:36,664 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:36,796 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073741966_1142 to datanode(s) 127.0.0.1:50539
2015-02-12 14:46:36,797 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741955_1131, blk_1073741956_1132, blk_1073741957_1133, blk_1073741958_1134, blk_1073741959_1135, blk_1073741960_1136, blk_1073741961_1137]
2015-02-12 14:46:36,797 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741955_1131, blk_1073741956_1132, blk_1073741957_1133, blk_1073741958_1134, blk_1073741960_1136, blk_1073741961_1137]
2015-02-12 14:46:37,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955 for deletion
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956 for deletion
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741957 for deletion
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741958 for deletion
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741960_1136 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741960 for deletion
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741961_1137 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741961 for deletion
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741957
2015-02-12 14:46:37,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956
2015-02-12 14:46:37,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741960_1136 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741960
2015-02-12 14:46:37,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741958
2015-02-12 14:46:37,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741961_1137 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741961
2015-02-12 14:46:37,670 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:37,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:37,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:46:37,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:46:37,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:46:38,016 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 to 127.0.0.1:50539
2015-02-12 14:46:38,017 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 src: /127.0.0.1:52023 dest: /127.0.0.1:50539
2015-02-12 14:46:38,018 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:46:38,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142 src: /127.0.0.1:52023 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:46:38,021 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741966_1142 size 254067
2015-02-12 14:46:38,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013 dst=null perm=null proto=rpc
2015-02-12 14:46:38,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:46:38,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:46:38,270 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955 for deletion
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956 for deletion
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741957 for deletion
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741958 for deletion
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741959 for deletion
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741957
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956
2015-02-12 14:46:38,271 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741960_1136 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741960 for deletion
2015-02-12 14:46:38,272 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741958
2015-02-12 14:46:38,272 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741961_1137 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741961 for deletion
2015-02-12 14:46:38,272 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741959
2015-02-12 14:46:38,272 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741960_1136 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741960
2015-02-12 14:46:38,273 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741961_1137 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741961
2015-02-12 14:46:38,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:38,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:38,677 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:39,360 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:39,364 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0013_000001
2015-02-12 14:46:39,364 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0013 APPATTEMPTID=appattempt_1423780884992_0013_000001
2015-02-12 14:46:39,364 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:46:39,365 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from ACCEPTED to RUNNING
2015-02-12 14:46:39,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:39,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:46:39,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:39,553 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:46:39,554 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:46:39,679 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:39,782 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:46:39,805 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741955_1131, blk_1073741956_1132, blk_1073741957_1133, blk_1073741958_1134, blk_1073741959_1135, blk_1073741960_1136]
2015-02-12 14:46:39,805 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741955_1131, blk_1073741956_1132, blk_1073741959_1135, blk_1073741961_1137]
2015-02-12 14:46:39,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146 src: /127.0.0.1:52030 dest: /127.0.0.1:50539
2015-02-12 14:46:39,843 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146 src: /127.0.0.1:52031 dest: /127.0.0.1:50549
2015-02-12 14:46:39,844 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146 src: /127.0.0.1:52032 dest: /127.0.0.1:50543
2015-02-12 14:46:39,886 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52032, dest: /127.0.0.1:50543, bytes: 114650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146, duration: 38316000
2015-02-12 14:46:39,886 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:39,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:39,887 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52031, dest: /127.0.0.1:50549, bytes: 114650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146, duration: 39003000
2015-02-12 14:46:39,887 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:39,888 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52030, dest: /127.0.0.1:50539, bytes: 114650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146, duration: 40240000
2015-02-12 14:46:39,888 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:39,888 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:39,889 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:39,894 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:39,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:39,936 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:46:39,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147 src: /127.0.0.1:52033 dest: /127.0.0.1:50539
2015-02-12 14:46:39,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147 src: /127.0.0.1:52034 dest: /127.0.0.1:50549
2015-02-12 14:46:39,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147 src: /127.0.0.1:52035 dest: /127.0.0.1:50546
2015-02-12 14:46:39,948 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52035, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147, duration: 1711000
2015-02-12 14:46:39,949 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:39,950 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52034, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147, duration: 3058000
2015-02-12 14:46:39,950 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:39,951 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:39,951 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52033, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147, duration: 4549000
2015-02-12 14:46:39,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:39,951 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0012_01_000001 succeeded
2015-02-12 14:46:39,952 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:39,953 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:46:39,953 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0012_01_000001
2015-02-12 14:46:39,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:39,965 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013.summary is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:39,979 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000001
2015-02-12 14:46:39,979 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000001
2015-02-12 14:46:39,979 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000001
2015-02-12 14:46:39,979 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012/container_1423780884992_0012_01_000001
2015-02-12 14:46:39,979 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000001
2015-02-12 14:46:39,979 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0012_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:46:39,980 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0012_01_000001 from application application_1423780884992_0012
2015-02-12 14:46:39,980 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:39,980 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0012
2015-02-12 14:46:40,516 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:40,516 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000002
2015-02-12 14:46:40,516 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:40,593 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:40,593 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000003
2015-02-12 14:46:40,593 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:40,663 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955 for deletion
2015-02-12 14:46:40,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956 for deletion
2015-02-12 14:46:40,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741957 for deletion
2015-02-12 14:46:40,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741958 for deletion
2015-02-12 14:46:40,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955
2015-02-12 14:46:40,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741959 for deletion
2015-02-12 14:46:40,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741960_1136 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741960 for deletion
2015-02-12 14:46:40,666 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741957
2015-02-12 14:46:40,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956
2015-02-12 14:46:40,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741959
2015-02-12 14:46:40,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741958
2015-02-12 14:46:40,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741960_1136 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741960
2015-02-12 14:46:40,686 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0012_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:40,686 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0012_000001
2015-02-12 14:46:40,687 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0012_000001
2015-02-12 14:46:40,688 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0012_000001 State change from FINISHING to FINISHED
2015-02-12 14:46:40,686 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0012_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:46:40,688 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000001
2015-02-12 14:46:40,688 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:40,688 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0012 State change from FINISHING to FINISHED
2015-02-12 14:46:40,688 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0012_000001 released container container_1423780884992_0012_01_000001 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:40,689 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:40,689 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0012
2015-02-12 14:46:40,689 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0012_000001
2015-02-12 14:46:40,689 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:40,689 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000004
2015-02-12 14:46:40,689 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:40,690 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0012_000001 is done. finalState=FINISHED
2015-02-12 14:46:40,690 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0012 requests cleared
2015-02-12 14:46:40,689 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0012,name=[1DCDE7771A794C78A6EB2DDB2AC6C19C/04E744CB82324EB9B4870A93FB0DA514] lower*upper/(1/1) ...latform/cogroupinnerouter,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0012/jobhistory/job/job_1423780884992_0012,appMasterHost=10.1.1.67,startTime=1423781171183,finishTime=1423781193867,finalStatus=SUCCEEDED
2015-02-12 14:46:40,691 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0012_000001 (auth:SIMPLE)
2015-02-12 14:46:40,693 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0012_01_000001
2015-02-12 14:46:40,693 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0012 CONTAINERID=container_1423780884992_0012_01_000001
2015-02-12 14:46:40,694 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0012_01_000001]
2015-02-12 14:46:40,694 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:40,694 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:40,694 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:40,694 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:40,694 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000005
2015-02-12 14:46:40,695 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:46:40,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:40,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:40,695 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0012
2015-02-12 14:46:40,695 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:40,696 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0012, with delay of 10800 seconds
2015-02-12 14:46:40,696 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:40,694 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,017 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955 for deletion
2015-02-12 14:46:41,018 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956 for deletion
2015-02-12 14:46:41,018 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741959 for deletion
2015-02-12 14:46:41,018 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741961_1137 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741961 for deletion
2015-02-12 14:46:41,018 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741956
2015-02-12 14:46:41,018 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741955
2015-02-12 14:46:41,019 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741961_1137 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741961
2015-02-12 14:46:41,019 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741959
2015-02-12 14:46:41,397 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:41,398 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:41,398 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000006
2015-02-12 14:46:41,398 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:46:41,398 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,399 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0012
2015-02-12 14:46:41,399 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:41,400 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0012, with delay of 10800 seconds
2015-02-12 14:46:41,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,469 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0013_01_000002
2015-02-12 14:46:41,470 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:41,470 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0013_01_000003
2015-02-12 14:46:41,470 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:41,470 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0013_01_000004
2015-02-12 14:46:41,471 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:41,471 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:41,471 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0013_01_000006
2015-02-12 14:46:41,471 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:41,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,525 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:41,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:41,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,526 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0012
2015-02-12 14:46:41,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,526 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:41,526 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0012, with delay of 10800 seconds
2015-02-12 14:46:41,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:41,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:41,593 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:46:41,594 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,594 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,594 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,595 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0012
2015-02-12 14:46:41,594 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0012
2015-02-12 14:46:41,595 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:46:41,595 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0012, with delay of 10800 seconds
2015-02-12 14:46:41,628 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:41,628 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:41,628 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:41,629 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:41,630 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:41,636 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000006 by user soberoi
2015-02-12 14:46:41,636 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000003 by user soberoi
2015-02-12 14:46:41,636 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000005 by user soberoi
2015-02-12 14:46:41,636 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0013
2015-02-12 14:46:41,636 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000003
2015-02-12 14:46:41,636 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000006 to application application_1423780884992_0013
2015-02-12 14:46:41,637 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:46:41,637 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,637 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,637 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:41,637 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0013
2015-02-12 14:46:41,636 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000006
2015-02-12 14:46:41,638 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:41,638 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from NEW to INITING
2015-02-12 14:46:41,638 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000003 to application application_1423780884992_0013
2015-02-12 14:46:41,638 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from INITING to RUNNING
2015-02-12 14:46:41,636 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0013
2015-02-12 14:46:41,639 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000004 by user soberoi
2015-02-12 14:46:41,640 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000004
2015-02-12 14:46:41,639 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:46:41,644 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,645 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,645 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000002 by user soberoi
2015-02-12 14:46:41,645 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000004 to application application_1423780884992_0013
2015-02-12 14:46:41,645 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from NEW to INITING
2015-02-12 14:46:41,640 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000005
2015-02-12 14:46:41,645 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000005 to application application_1423780884992_0013
2015-02-12 14:46:41,646 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from INITING to RUNNING
2015-02-12 14:46:41,647 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:46:41,647 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:46:41,647 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,647 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,647 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:41,647 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0013
2015-02-12 14:46:41,647 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:41,648 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:41,648 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,648 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,648 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:41,648 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0013
2015-02-12 14:46:41,648 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0013_01_000005
2015-02-12 14:46:41,645 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0013
2015-02-12 14:46:41,649 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000002
2015-02-12 14:46:41,645 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:41,651 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0013
2015-02-12 14:46:41,651 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from NEW to INITING
2015-02-12 14:46:41,652 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:41,652 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:41,653 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0013_01_000003
2015-02-12 14:46:41,653 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0013_01_000004
2015-02-12 14:46:41,652 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000002 to application application_1423780884992_0013
2015-02-12 14:46:41,654 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from INITING to RUNNING
2015-02-12 14:46:41,655 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:46:41,655 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,655 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0013
2015-02-12 14:46:41,655 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:41,655 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0013
2015-02-12 14:46:41,655 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:41,655 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:41,655 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0013_01_000002
2015-02-12 14:46:41,688 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0013_01_000005.tokens. Credentials list:
2015-02-12 14:46:41,688 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0013_01_000004.tokens. Credentials list:
2015-02-12 14:46:41,688 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0013_01_000002.tokens. Credentials list:
2015-02-12 14:46:41,689 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0013_01_000003.tokens. Credentials list:
2015-02-12 14:46:41,702 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:41,702 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:41,702 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:41,710 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:41,710 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:41,900 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:41,902 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:41,917 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:41,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000006/default_container_executor.sh]
2015-02-12 14:46:42,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0013_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000002.tokens
2015-02-12 14:46:42,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:46:42,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0013_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000005.tokens
2015-02-12 14:46:42,152 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:46:42,152 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0013_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000003.tokens
2015-02-12 14:46:42,152 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:46:42,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:42,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:42,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:42,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:42,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:42,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:42,374 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0013/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:42,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:42,412 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0013/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:42,432 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0013/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:42,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:42,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:42,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:42,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:42,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:42,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:42,484 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:46:42,510 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0013/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:42,510 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:42,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:42,534 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0013/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:42,534 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:42,556 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:42,556 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:42,556 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:42,583 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:42,583 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:42,595 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:42,598 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:42,598 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:42,615 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:42,615 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:42,615 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:42,615 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:42,693 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142
2015-02-12 14:46:42,693 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143
2015-02-12 14:46:42,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000002/default_container_executor.sh]
2015-02-12 14:46:42,815 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000003/default_container_executor.sh]
2015-02-12 14:46:42,819 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000004/default_container_executor.sh]
2015-02-12 14:46:42,822 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000005/default_container_executor.sh]
2015-02-12 14:46:42,899 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140
2015-02-12 14:46:42,900 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139
2015-02-12 14:46:42,900 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144
2015-02-12 14:46:43,232 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139
2015-02-12 14:46:43,232 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138
2015-02-12 14:46:43,260 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140
2015-02-12 14:46:43,260 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138
2015-02-12 14:46:43,260 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144
2015-02-12 14:46:43,261 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143
2015-02-12 14:46:43,262 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145
2015-02-12 14:46:43,344 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143
2015-02-12 14:46:43,345 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741964_1140
2015-02-12 14:46:43,438 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142
2015-02-12 14:46:43,439 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741967_1143
2015-02-12 14:46:43,439 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741968_1144
2015-02-12 14:46:43,440 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145
2015-02-12 14:46:43,471 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142
2015-02-12 14:46:43,473 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141
2015-02-12 14:46:43,547 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741966_1142
2015-02-12 14:46:43,548 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741963_1139
2015-02-12 14:46:43,548 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741962_1138
2015-02-12 14:46:43,549 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141
2015-02-12 14:46:43,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:43,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741965_1141
2015-02-12 14:46:43,755 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741969_1145
2015-02-12 14:46:43,766 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0013_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000004.tokens
2015-02-12 14:46:43,766 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:46:47,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146
2015-02-12 14:46:48,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147
2015-02-12 14:46:48,644 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147
2015-02-12 14:46:48,645 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146
2015-02-12 14:46:48,762 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741971_1147
2015-02-12 14:46:48,763 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741970_1146
2015-02-12 14:46:51,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:51,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:51,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:51,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:51,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:51,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:51,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:51,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:51,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:51,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:46:52,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:46:52,068 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:52,070 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000006
2015-02-12 14:46:52,070 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000006
2015-02-12 14:46:52,070 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:46:52,070 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000006
2015-02-12 14:46:52,094 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0013_01_000006 is : 143
2015-02-12 14:46:52,096 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:46:52,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148 src: /127.0.0.1:52070 dest: /127.0.0.1:50539
2015-02-12 14:46:52,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148 src: /127.0.0.1:52071 dest: /127.0.0.1:50549
2015-02-12 14:46:52,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148 src: /127.0.0.1:52072 dest: /127.0.0.1:50543
2015-02-12 14:46:52,116 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist for DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:52,119 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:52,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000006
2015-02-12 14:46:52,122 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000006
2015-02-12 14:46:52,122 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000006
2015-02-12 14:46:52,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000006
2015-02-12 14:46:52,125 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000006
2015-02-12 14:46:52,126 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:52,126 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000006 from application application_1423780884992_0013
2015-02-12 14:46:52,126 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:52,127 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:46:52,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:46:52,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:46:52,360 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:52,362 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000005
2015-02-12 14:46:52,363 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000005
2015-02-12 14:46:52,363 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:46:52,363 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000005
2015-02-12 14:46:52,386 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0013_01_000005 is : 143
2015-02-12 14:46:52,403 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:52,404 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000005
2015-02-12 14:46:52,405 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000005
2015-02-12 14:46:52,405 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000005
2015-02-12 14:46:52,406 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000005
2015-02-12 14:46:52,407 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000005
2015-02-12 14:46:52,409 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:52,409 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000005 from application application_1423780884992_0013
2015-02-12 14:46:52,409 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:52,409 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:46:52,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:52,450 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:52,453 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000002
2015-02-12 14:46:52,453 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000002
2015-02-12 14:46:52,454 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:46:52,454 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000002
2015-02-12 14:46:52,472 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:52,474 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000003
2015-02-12 14:46:52,474 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000003
2015-02-12 14:46:52,474 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:46:52,474 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000003
2015-02-12 14:46:52,475 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0013_01_000002 is : 143
2015-02-12 14:46:52,485 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:52,486 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000002
2015-02-12 14:46:52,486 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000002
2015-02-12 14:46:52,486 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000002
2015-02-12 14:46:52,486 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:52,487 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000002 from application application_1423780884992_0013
2015-02-12 14:46:52,487 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000002
2015-02-12 14:46:52,487 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000002
2015-02-12 14:46:52,487 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:52,488 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:46:52,492 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0013_01_000003 is : 143
2015-02-12 14:46:52,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:46:52,507 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:52,507 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000003
2015-02-12 14:46:52,507 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000003
2015-02-12 14:46:52,508 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000003
2015-02-12 14:46:52,510 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000003
2015-02-12 14:46:52,511 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000003
2015-02-12 14:46:52,512 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:52,513 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000003 from application application_1423780884992_0013
2015-02-12 14:46:52,513 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:52,514 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:46:52,561 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:52,563 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000004
2015-02-12 14:46:52,563 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000004
2015-02-12 14:46:52,564 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:46:52,564 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000004
2015-02-12 14:46:52,564 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:52,565 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:46:52,565 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000005
2015-02-12 14:46:52,565 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:46:52,565 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000005 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:46:52,588 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0013_01_000004 is : 143
2015-02-12 14:46:52,601 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:52,601 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000004
2015-02-12 14:46:52,602 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000004
2015-02-12 14:46:52,602 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000004
2015-02-12 14:46:52,603 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000004
2015-02-12 14:46:52,603 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000004
2015-02-12 14:46:52,603 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:52,603 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000004 from application application_1423780884992_0013
2015-02-12 14:46:52,604 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:52,605 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:46:53,075 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:53,076 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:46:53,076 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000006
2015-02-12 14:46:53,076 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:46:53,076 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000006 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:46:53,464 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:53,464 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:46:53,465 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000002
2015-02-12 14:46:53,465 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:53,465 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000002 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:53,480 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:53,480 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:46:53,481 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000003
2015-02-12 14:46:53,481 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:53,481 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:53,573 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:53,573 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:46:53,573 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000004
2015-02-12 14:46:53,573 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:53,573 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:53,573 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:53,574 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:53,574 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000007
2015-02-12 14:46:53,574 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0013_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:46:54,084 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:54,470 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:54,485 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:54,582 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:54,582 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:54,583 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:54,594 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:54,596 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0013_01_000007 by user soberoi
2015-02-12 14:46:54,596 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000007
2015-02-12 14:46:54,596 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0013_01_000007 to application application_1423780884992_0013
2015-02-12 14:46:54,597 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:46:54,597 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0013
2015-02-12 14:46:54,597 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0013
2015-02-12 14:46:54,597 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:46:54,597 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0013
2015-02-12 14:46:54,598 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:46:54,626 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:46:54,626 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:54,748 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000007/default_container_executor.sh]
2015-02-12 14:46:55,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0013_01_000006]
2015-02-12 14:46:55,092 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:55,478 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0013_01_000002]
2015-02-12 14:46:55,478 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:55,495 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0013_01_000003]
2015-02-12 14:46:55,495 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:55,586 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0013_01_000005]
2015-02-12 14:46:55,586 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:46:55,586 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:55,586 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:55,594 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:46:56,592 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0013_01_000004]
2015-02-12 14:46:56,592 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:57,229 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:57,232 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:57,234 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:57,237 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:57,244 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:46:57,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,568 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:46:57,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149 src: /127.0.0.1:52086 dest: /127.0.0.1:50549
2015-02-12 14:46:57,667 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149 src: /127.0.0.1:52087 dest: /127.0.0.1:50539
2015-02-12 14:46:57,669 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149 src: /127.0.0.1:52088 dest: /127.0.0.1:50546
2015-02-12 14:46:57,705 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52088, dest: /127.0.0.1:50546, bytes: 221, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0013_r_000000_0_-2018924861_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149, duration: 34772000
2015-02-12 14:46:57,706 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:57,706 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52087, dest: /127.0.0.1:50539, bytes: 221, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0013_r_000000_0_-2018924861_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149, duration: 35508000
2015-02-12 14:46:57,706 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,713 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:46:57,713 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52086, dest: /127.0.0.1:50549, bytes: 221, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0013_r_000000_0_-2018924861_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149, duration: 42770000
2015-02-12 14:46:57,714 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,716 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:57,717 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:57,721 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0013_r_000000_0_-2018924861_1
2015-02-12 14:46:57,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:57,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:46:57,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/task_1423780884992_0013_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:46:57,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0013_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/task_1423780884992_0013_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:46:57,778 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:46:57,782 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000007
2015-02-12 14:46:57,782 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000007
2015-02-12 14:46:57,782 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:46:57,783 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000007
2015-02-12 14:46:57,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,803 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:57,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:46:57,826 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0013_01_000007 is : 143
2015-02-12 14:46:57,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:57,829 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:46:57,830 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000007
2015-02-12 14:46:57,830 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:46:57,830 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000007 from application application_1423780884992_0013
2015-02-12 14:46:57,830 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:46:57,830 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:46:57,831 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000007
2015-02-12 14:46:57,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:57,832 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000007
2015-02-12 14:46:57,832 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000007
2015-02-12 14:46:57,835 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000007
2015-02-12 14:46:57,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/task_1423780884992_0013_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:46:57,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:57,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary/1/task_1423780884992_0013_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:46:57,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,871 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:57,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,876 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:57,898 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52072, dest: /127.0.0.1:50543, bytes: 69232, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148, duration: 5789424000
2015-02-12 14:46:57,898 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:57,899 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16374
2015-02-12 14:46:57,900 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52071, dest: /127.0.0.1:50549, bytes: 69232, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148, duration: 5787027000
2015-02-12 14:46:57,900 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,901 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16374
2015-02-12 14:46:57,901 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52070, dest: /127.0.0.1:50539, bytes: 69232, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148, duration: 5789384000
2015-02-12 14:46:57,902 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,902 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16374
2015-02-12 14:46:57,905 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:57,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,912 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:46:57,915 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150 src: /127.0.0.1:52090 dest: /127.0.0.1:50543
2015-02-12 14:46:57,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150 src: /127.0.0.1:52091 dest: /127.0.0.1:50549
2015-02-12 14:46:57,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150 src: /127.0.0.1:52092 dest: /127.0.0.1:50546
2015-02-12 14:46:57,938 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52092, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150, duration: 10428000
2015-02-12 14:46:57,938 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:57,939 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:57,939 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52091, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150, duration: 2419000
2015-02-12 14:46:57,939 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,940 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:46:57,940 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52090, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150, duration: 3583000
2015-02-12 14:46:57,940 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,941 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:57,942 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:57,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:57,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:57,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:57,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:57,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:57,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:46:57,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:57,972 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:46:57,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151 src: /127.0.0.1:52094 dest: /127.0.0.1:50543
2015-02-12 14:46:57,979 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151 src: /127.0.0.1:52095 dest: /127.0.0.1:50546
2015-02-12 14:46:57,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151 src: /127.0.0.1:52096 dest: /127.0.0.1:50539
2015-02-12 14:46:57,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52096, dest: /127.0.0.1:50539, bytes: 69232, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151, duration: 5295000
2015-02-12 14:46:57,988 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:57,989 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52095, dest: /127.0.0.1:50546, bytes: 69232, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151, duration: 6240000
2015-02-12 14:46:57,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:46:57,989 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,990 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:57,990 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52094, dest: /127.0.0.1:50543, bytes: 69232, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151, duration: 7513000
2015-02-12 14:46:57,991 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:57,991 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:57,993 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:57,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:57,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:57,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:58,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:58,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:46:58,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013/job_1423780884992_0013_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:46:58,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:46:58,014 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:46:58,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152 src: /127.0.0.1:52098 dest: /127.0.0.1:50546
2015-02-12 14:46:58,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152 src: /127.0.0.1:52099 dest: /127.0.0.1:50539
2015-02-12 14:46:58,024 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152 src: /127.0.0.1:52100 dest: /127.0.0.1:50543
2015-02-12 14:46:58,030 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52100, dest: /127.0.0.1:50543, bytes: 114650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152, duration: 2675000
2015-02-12 14:46:58,031 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:58,031 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:58,032 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52099, dest: /127.0.0.1:50539, bytes: 114650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152, duration: 3747000
2015-02-12 14:46:58,032 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:58,035 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52098, dest: /127.0.0.1:50546, bytes: 114650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1405286109_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152, duration: 6660000
2015-02-12 14:46:58,035 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:58,036 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:58,038 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:58,040 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1405286109_1
2015-02-12 14:46:58,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:58,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:58,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:58,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:46:58,059 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0013_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:46:58,059 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:46:58,059 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0013 with final state: FINISHING
2015-02-12 14:46:58,059 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from RUNNING to FINAL_SAVING
2015-02-12 14:46:58,060 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0013
2015-02-12 14:46:58,060 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:46:58,060 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from FINAL_SAVING to FINISHING
2015-02-12 14:46:58,784 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:46:58,784 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:46:58,784 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000007
2015-02-12 14:46:58,784 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:46:58,784 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000007 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:46:59,066 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0013 unregistered successfully.
2015-02-12 14:46:59,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741966_1142 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:46:59,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741967_1143 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:46:59,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741968_1144 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:46:59,071 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741969_1145 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:46:59,071 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741971_1147 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:46:59,071 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741972_1148 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:46:59,071 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741970_1146 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:46:59,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0013 dst=null perm=null proto=rpc
2015-02-12 14:46:59,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,112 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary
2015-02-12 14:46:59,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:46:59,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,129 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:59,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:59,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,151 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:59,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:59,156 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter
2015-02-12 14:46:59,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:59,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:59,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:59,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter dst=null perm=null proto=rpc
2015-02-12 14:46:59,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:59,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:59,162 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup
2015-02-12 14:46:59,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:46:59,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:59,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouter-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:46:59,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,190 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:46:59,191 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:46:59,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:46:59,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:46:59,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:46:59,204 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:46:59,205 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields"]
2015-02-12 14:46:59,205 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:46:59,205 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:46:59,205 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:46:59,207 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dpipesplatform/difffields
2015-02-12 14:46:59,220 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:46:59,232 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:46:59,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:46:59,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:59,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:46:59,237 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 14
2015-02-12 14:46:59,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014 dst=null perm=null proto=rpc
2015-02-12 14:46:59,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:46:59,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:46:59,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,248 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:46:59,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 src: /127.0.0.1:52106 dest: /127.0.0.1:50543
2015-02-12 14:46:59,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 src: /127.0.0.1:52107 dest: /127.0.0.1:50539
2015-02-12 14:46:59,255 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 src: /127.0.0.1:52108 dest: /127.0.0.1:50549
2015-02-12 14:46:59,260 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52108, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153, duration: 2359000
2015-02-12 14:46:59,260 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:59,264 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,264 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52107, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153, duration: 3468000
2015-02-12 14:46:59,264 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,266 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52106, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153, duration: 7380000
2015-02-12 14:46:59,266 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,266 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,268 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,269 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:59,270 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar
2015-02-12 14:46:59,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:46:59,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:46:59,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:46:59,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:46:59,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:46:59,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,282 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:59,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,285 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:59,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,288 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:59,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,294 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:46:59,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:46:59,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,300 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split
2015-02-12 14:46:59,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:59,304 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:46:59,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154 src: /127.0.0.1:52109 dest: /127.0.0.1:50546
2015-02-12 14:46:59,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154 src: /127.0.0.1:52110 dest: /127.0.0.1:50539
2015-02-12 14:46:59,310 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154 src: /127.0.0.1:52111 dest: /127.0.0.1:50543
2015-02-12 14:46:59,313 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154 src: /127.0.0.1:52112 dest: /127.0.0.1:50549
2015-02-12 14:46:59,316 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52112, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, duration: 1567000
2015-02-12 14:46:59,317 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:59,317 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52111, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, duration: 2144000
2015-02-12 14:46:59,317 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,318 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,318 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,318 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52110, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, duration: 2864000
2015-02-12 14:46:59,319 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,319 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,319 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52109, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, duration: 4304000
2015-02-12 14:46:59,320 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,320 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,323 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:59,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,328 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:46:59,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155 src: /127.0.0.1:52113 dest: /127.0.0.1:50549
2015-02-12 14:46:59,332 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155 src: /127.0.0.1:52114 dest: /127.0.0.1:50543
2015-02-12 14:46:59,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155 src: /127.0.0.1:52115 dest: /127.0.0.1:50539
2015-02-12 14:46:59,336 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52115, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155, duration: 1198000
2015-02-12 14:46:59,336 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:59,337 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52114, dest: /127.0.0.1:50543, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155, duration: 1951000
2015-02-12 14:46:59,337 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,337 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,338 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52113, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155, duration: 3203000
2015-02-12 14:46:59,338 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,339 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,342 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:59,343 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:46:59,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:46:59,354 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:46:59,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156 src: /127.0.0.1:52116 dest: /127.0.0.1:50543
2015-02-12 14:46:59,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156 src: /127.0.0.1:52117 dest: /127.0.0.1:50546
2015-02-12 14:46:59,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156 src: /127.0.0.1:52118 dest: /127.0.0.1:50539
2015-02-12 14:46:59,364 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52118, dest: /127.0.0.1:50539, bytes: 97186, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156, duration: 1640000
2015-02-12 14:46:59,364 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:46:59,365 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,365 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52117, dest: /127.0.0.1:50546, bytes: 97186, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156, duration: 2128000
2015-02-12 14:46:59,366 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,367 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52116, dest: /127.0.0.1:50543, bytes: 97186, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156, duration: 3851000
2015-02-12 14:46:59,368 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:46:59,369 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:46:59,373 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:46:59,373 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0014
2015-02-12 14:46:59,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014 dst=null perm=null proto=rpc
2015-02-12 14:46:59,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:59,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:46:59,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:59,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:59,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:59,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:59,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,393 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 14 submitted by user soberoi
2015-02-12 14:46:59,393 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0014
2015-02-12 14:46:59,393 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0014
2015-02-12 14:46:59,393 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0014
2015-02-12 14:46:59,393 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from NEW to NEW_SAVING
2015-02-12 14:46:59,394 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:46:59,394 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0014 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:46:59,394 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from SUBMITTED to ACCEPTED
2015-02-12 14:46:59,394 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0014
2015-02-12 14:46:59,394 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0014_000001
2015-02-12 14:46:59,395 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from NEW to SUBMITTED
2015-02-12 14:46:59,395 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0014_000001 to scheduler from user: soberoi
2015-02-12 14:46:59,396 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:46:59,397 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0014/
2015-02-12 14:46:59,397 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0014
2015-02-12 14:46:59,398 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0014/
2015-02-12 14:46:59,513 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:46:59,513 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000001
2015-02-12 14:46:59,513 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:46:59,513 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0014_01_000001
2015-02-12 14:46:59,514 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:46:59,514 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0014_000001
2015-02-12 14:46:59,514 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0014 AttemptId: appattempt_1423780884992_0014_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0014_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:46:59,514 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:46:59,515 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:46:59,515 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0014_000001
2015-02-12 14:46:59,516 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0014_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0014_000001
2015-02-12 14:46:59,516 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0014_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:46:59,516 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0014_000001
2015-02-12 14:46:59,516 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0014_000001
2015-02-12 14:46:59,519 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:46:59,521 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000001 by user soberoi
2015-02-12 14:46:59,521 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0014
2015-02-12 14:46:59,521 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000001
2015-02-12 14:46:59,521 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from NEW to INITING
2015-02-12 14:46:59,521 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000001 to application application_1423780884992_0014
2015-02-12 14:46:59,522 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from INITING to RUNNING
2015-02-12 14:46:59,522 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0014_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0014_000001
2015-02-12 14:46:59,522 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:46:59,522 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:46:59,522 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:46:59,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:46:59,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:46:59,523 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:46:59,523 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:46:59,523 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0014_01_000001
2015-02-12 14:46:59,533 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0014_01_000001.tokens. Credentials list:
2015-02-12 14:46:59,641 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:46:59,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0014_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000001.tokens
2015-02-12 14:46:59,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:46:59,791 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:46:59,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:46:59,865 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0014/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:59,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:59,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:46:59,935 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0014/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:46:59,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:46:59,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:00,000 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:00,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:00,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:00,070 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0014/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:00,070 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:00,115 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:00,115 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:00,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000001/default_container_executor.sh]
2015-02-12 14:47:00,519 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:00,794 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:00,843 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073741977_1153 to datanode(s) 127.0.0.1:50546
2015-02-12 14:47:00,843 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741968_1144, blk_1073741969_1145, blk_1073741971_1147, blk_1073741966_1142, blk_1073741967_1143]
2015-02-12 14:47:00,843 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741969_1145, blk_1073741970_1146, blk_1073741971_1147, blk_1073741972_1148, blk_1073741966_1142, blk_1073741967_1143]
2015-02-12 14:47:01,803 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:02,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741968_1144 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741968 for deletion
2015-02-12 14:47:02,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741969 for deletion
2015-02-12 14:47:02,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741971_1147 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741971 for deletion
2015-02-12 14:47:02,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741968_1144 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741968
2015-02-12 14:47:02,057 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966 for deletion
2015-02-12 14:47:02,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741969
2015-02-12 14:47:02,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967 for deletion
2015-02-12 14:47:02,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741971_1147 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741971
2015-02-12 14:47:02,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966
2015-02-12 14:47:02,058 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967
2015-02-12 14:47:02,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:02,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:47:02,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:47:02,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:47:02,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014 dst=null perm=null proto=rpc
2015-02-12 14:47:02,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:47:02,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:47:02,309 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 to 127.0.0.1:50546
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741969 for deletion
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741970_1146 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741970 for deletion
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741971_1147 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741971 for deletion
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741972 for deletion
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741969
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966 for deletion
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967 for deletion
2015-02-12 14:47:02,310 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741971_1147 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741971
2015-02-12 14:47:02,311 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741970_1146 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741970
2015-02-12 14:47:02,311 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741972
2015-02-12 14:47:02,311 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:47:02,311 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967
2015-02-12 14:47:02,311 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966
2015-02-12 14:47:02,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 src: /127.0.0.1:52124 dest: /127.0.0.1:50546
2015-02-12 14:47:02,313 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153 src: /127.0.0.1:52124 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:47:02,314 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741977_1153 size 254067
2015-02-12 14:47:02,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:02,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:02,808 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:02,950 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148
2015-02-12 14:47:03,451 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:03,453 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0014_000001
2015-02-12 14:47:03,453 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0014 APPATTEMPTID=appattempt_1423780884992_0014_000001
2015-02-12 14:47:03,453 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:47:03,453 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from ACCEPTED to RUNNING
2015-02-12 14:47:03,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:03,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151
2015-02-12 14:47:03,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149
2015-02-12 14:47:03,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152
2015-02-12 14:47:03,510 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150
2015-02-12 14:47:03,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:47:03,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:03,669 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151
2015-02-12 14:47:03,670 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152
2015-02-12 14:47:03,671 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741972_1148
2015-02-12 14:47:03,671 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149
2015-02-12 14:47:03,787 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150
2015-02-12 14:47:03,788 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741973_1149
2015-02-12 14:47:03,810 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:03,844 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741968_1144, blk_1073741969_1145, blk_1073741970_1146, blk_1073741971_1147, blk_1073741972_1148, blk_1073741966_1142, blk_1073741967_1143]
2015-02-12 14:47:03,844 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741968_1144, blk_1073741970_1146, blk_1073741972_1148, blk_1073741966_1142, blk_1073741967_1143]
2015-02-12 14:47:03,907 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:47:03,970 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157 src: /127.0.0.1:52131 dest: /127.0.0.1:50549
2015-02-12 14:47:03,972 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157 src: /127.0.0.1:52132 dest: /127.0.0.1:50546
2015-02-12 14:47:03,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157 src: /127.0.0.1:52133 dest: /127.0.0.1:50543
2015-02-12 14:47:04,004 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52133, dest: /127.0.0.1:50543, bytes: 113901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157, duration: 26680000
2015-02-12 14:47:04,004 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:04,004 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:04,005 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52132, dest: /127.0.0.1:50546, bytes: 113901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157, duration: 26813000
2015-02-12 14:47:04,006 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:04,007 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52131, dest: /127.0.0.1:50549, bytes: 113901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157, duration: 29720000
2015-02-12 14:47:04,010 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:04,013 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:04,017 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:04,030 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1_conf.xml is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:04,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:04,068 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:47:04,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158 src: /127.0.0.1:52134 dest: /127.0.0.1:50539
2015-02-12 14:47:04,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158 src: /127.0.0.1:52135 dest: /127.0.0.1:50546
2015-02-12 14:47:04,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158 src: /127.0.0.1:52136 dest: /127.0.0.1:50543
2015-02-12 14:47:04,076 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52136, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158, duration: 1608000
2015-02-12 14:47:04,076 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:04,077 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52135, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158, duration: 2230000
2015-02-12 14:47:04,077 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:04,077 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:47:04,078 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52134, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158, duration: 3799000
2015-02-12 14:47:04,078 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:47:04,079 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:04,080 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:47:04,083 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014.summary is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:04,125 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0013_01_000001 succeeded
2015-02-12 14:47:04,126 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:47:04,126 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0013_01_000001
2015-02-12 14:47:04,142 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000001
2015-02-12 14:47:04,142 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000001
2015-02-12 14:47:04,142 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000001
2015-02-12 14:47:04,142 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000001
2015-02-12 14:47:04,143 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0013_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:47:04,143 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0013_01_000001 from application application_1423780884992_0013
2015-02-12 14:47:04,143 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:04,143 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0013
2015-02-12 14:47:04,143 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0013/container_1423780884992_0013_01_000001
2015-02-12 14:47:04,154 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0013_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:04,154 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0013_000001
2015-02-12 14:47:04,154 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0013_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:47:04,154 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0013_000001
2015-02-12 14:47:04,154 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000001
2015-02-12 14:47:04,155 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0013_000001 State change from FINISHING to FINISHED
2015-02-12 14:47:04,155 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0013_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:04,156 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0013_000001 released container container_1423780884992_0013_01_000001 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:04,155 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0013 State change from FINISHING to FINISHED
2015-02-12 14:47:04,156 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0013_000001 is done. finalState=FINISHED
2015-02-12 14:47:04,157 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0013
2015-02-12 14:47:04,157 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0013_000001
2015-02-12 14:47:04,157 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0013,name=[723A450D13BE46E797B2B9DC232B607D/C33B833ED08E40D89C69B175046E5EFE] lower*upper/(1/1) ...oupinnerouter-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0013/jobhistory/job/job_1423780884992_0013,appMasterHost=10.1.1.67,startTime=1423781195222,finishTime=1423781218059,finalStatus=SUCCEEDED
2015-02-12 14:47:04,157 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0013 requests cleared
2015-02-12 14:47:04,160 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0013_000001 (auth:SIMPLE)
2015-02-12 14:47:04,163 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0013_01_000001
2015-02-12 14:47:04,163 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0013 CONTAINERID=container_1423780884992_0013_01_000001
2015-02-12 14:47:04,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0013_01_000001]
2015-02-12 14:47:04,164 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:04,164 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:04,167 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,167 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0013
2015-02-12 14:47:04,167 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:04,167 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0013, with delay of 10800 seconds
2015-02-12 14:47:04,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,169 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,169 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,543 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:04,544 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:04,544 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000002
2015-02-12 14:47:04,544 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,544 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:47:04,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,546 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,546 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0013
2015-02-12 14:47:04,546 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:04,546 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0013, with delay of 10800 seconds
2015-02-12 14:47:04,546 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,547 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:04,548 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:04,548 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000003
2015-02-12 14:47:04,548 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:04,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,549 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,549 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0013
2015-02-12 14:47:04,549 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:04,549 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0013, with delay of 10800 seconds
2015-02-12 14:47:04,549 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741968_1144 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741968 for deletion
2015-02-12 14:47:04,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741968_1144 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741968 for deletion
2015-02-12 14:47:04,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741969 for deletion
2015-02-12 14:47:04,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741970_1146 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741970 for deletion
2015-02-12 14:47:04,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741968_1144 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741968
2015-02-12 14:47:04,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741970_1146 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741970 for deletion
2015-02-12 14:47:04,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741972 for deletion
2015-02-12 14:47:04,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741968_1144 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741968
2015-02-12 14:47:04,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741969
2015-02-12 14:47:04,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741971_1147 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741971 for deletion
2015-02-12 14:47:04,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741970_1146 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741970
2015-02-12 14:47:04,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741972 for deletion
2015-02-12 14:47:04,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966 for deletion
2015-02-12 14:47:04,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967 for deletion
2015-02-12 14:47:04,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966 for deletion
2015-02-12 14:47:04,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967 for deletion
2015-02-12 14:47:04,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741971_1147 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741971
2015-02-12 14:47:04,700 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741972
2015-02-12 14:47:04,700 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966
2015-02-12 14:47:04,700 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967
2015-02-12 14:47:04,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741972
2015-02-12 14:47:04,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741970_1146 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741970
2015-02-12 14:47:04,701 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741966
2015-02-12 14:47:04,701 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741967
2015-02-12 14:47:04,817 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:04,817 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:04,818 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:04,818 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000004
2015-02-12 14:47:04,818 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:04,818 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,819 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0013
2015-02-12 14:47:04,819 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,819 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:04,819 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0013, with delay of 10800 seconds
2015-02-12 14:47:04,819 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:04,820 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0013
2015-02-12 14:47:05,167 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:05,168 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000005
2015-02-12 14:47:05,168 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:05,509 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0014_01_000002
2015-02-12 14:47:05,509 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:05,510 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0014_01_000003
2015-02-12 14:47:05,510 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:05,510 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0014_01_000004
2015-02-12 14:47:05,511 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:05,511 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0014_01_000005
2015-02-12 14:47:05,511 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:05,545 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:05,546 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000006
2015-02-12 14:47:05,546 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:47:05,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,554 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:05,555 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000007
2015-02-12 14:47:05,555 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:47:05,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:05,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:05,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:05,653 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:05,653 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:05,653 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:05,653 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:05,657 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000004 by user soberoi
2015-02-12 14:47:05,657 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000005 by user soberoi
2015-02-12 14:47:05,657 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0014
2015-02-12 14:47:05,657 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000002 by user soberoi
2015-02-12 14:47:05,657 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000004
2015-02-12 14:47:05,657 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000002 to application application_1423780884992_0014
2015-02-12 14:47:05,657 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from NEW to INITING
2015-02-12 14:47:05,657 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000003 by user soberoi
2015-02-12 14:47:05,658 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:47:05,658 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,658 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,658 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:05,658 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:05,658 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000004 to application application_1423780884992_0014
2015-02-12 14:47:05,658 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from INITING to RUNNING
2015-02-12 14:47:05,659 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:05,657 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000002
2015-02-12 14:47:05,657 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0014
2015-02-12 14:47:05,659 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000005
2015-02-12 14:47:05,659 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:47:05,660 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,660 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,660 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from NEW to INITING
2015-02-12 14:47:05,660 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000005 to application application_1423780884992_0014
2015-02-12 14:47:05,660 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from INITING to RUNNING
2015-02-12 14:47:05,661 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:47:05,661 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,661 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,661 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:05,661 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:05,661 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:05,661 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:05,662 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0014_01_000005
2015-02-12 14:47:05,658 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0014
2015-02-12 14:47:05,660 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:05,662 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:05,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:05,663 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:05,663 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0014_01_000004
2015-02-12 14:47:05,664 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from NEW to INITING
2015-02-12 14:47:05,664 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000003 to application application_1423780884992_0014
2015-02-12 14:47:05,665 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from INITING to RUNNING
2015-02-12 14:47:05,662 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000003
2015-02-12 14:47:05,665 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:47:05,666 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,666 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:05,666 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:05,666 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:05,666 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:05,666 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:05,667 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0014_01_000003
2015-02-12 14:47:05,687 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0014_01_000005.tokens. Credentials list:
2015-02-12 14:47:05,687 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0014_01_000003.tokens. Credentials list:
2015-02-12 14:47:05,688 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0014_01_000004.tokens. Credentials list:
2015-02-12 14:47:05,718 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:05,719 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:05,818 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:05,818 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:05,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:05,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:05,931 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:05,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000002/default_container_executor.sh]
2015-02-12 14:47:06,133 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0014_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000003.tokens
2015-02-12 14:47:06,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:06,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0014_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000004.tokens
2015-02-12 14:47:06,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:06,153 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0014_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000005.tokens
2015-02-12 14:47:06,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:06,174 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:06,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:06,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:06,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:06,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:06,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:06,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:06,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0014/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:06,369 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:06,369 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0014/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:06,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:06,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:06,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:06,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:06,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:06,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:06,473 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0014/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:06,473 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:06,494 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:06,494 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:06,494 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:06,495 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:06,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:06,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:06,541 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:06,542 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:06,543 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000006 by user soberoi
2015-02-12 14:47:06,544 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000006
2015-02-12 14:47:06,544 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000006 to application application_1423780884992_0014
2015-02-12 14:47:06,544 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:47:06,544 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:06,544 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:06,545 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:06,545 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:06,545 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000007 by user soberoi
2015-02-12 14:47:06,545 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:06,545 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000007
2015-02-12 14:47:06,545 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000007 to application application_1423780884992_0014
2015-02-12 14:47:06,546 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:47:06,546 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:06,546 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:06,546 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:06,546 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:06,547 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:06,548 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:06,548 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:06,548 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0014
2015-02-12 14:47:06,548 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000008 Container Transitioned from NEW to RESERVED
2015-02-12 14:47:06,548 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0014_01_000008 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@22bd1926
2015-02-12 14:47:06,550 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:06,550 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:06,556 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:06,556 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:06,556 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:06,557 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000009
2015-02-12 14:47:06,557 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:47:06,584 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:06,584 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:06,593 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:06,593 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:06,619 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:06,619 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:06,621 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:06,621 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:06,826 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:06,826 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000010
2015-02-12 14:47:06,826 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:47:06,827 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000004/default_container_executor.sh]
2015-02-12 14:47:06,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000005/default_container_executor.sh]
2015-02-12 14:47:06,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000003/default_container_executor.sh]
2015-02-12 14:47:06,890 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000007/default_container_executor.sh]
2015-02-12 14:47:06,901 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000006/default_container_executor.sh]
2015-02-12 14:47:07,539 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:47:07,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:07,540 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:07,554 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0014_000001 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096
2015-02-12 14:47:07,554 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0014 unreserved on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:47:07,959 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741976_1152
2015-02-12 14:47:07,960 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156
2015-02-12 14:47:07,961 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155
2015-02-12 14:47:07,961 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741974_1150
2015-02-12 14:47:07,962 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741975_1151
2015-02-12 14:47:08,166 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153
2015-02-12 14:47:08,166 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154
2015-02-12 14:47:08,516 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154
2015-02-12 14:47:08,517 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156
2015-02-12 14:47:08,548 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:47:08,549 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:47:08,549 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000009
2015-02-12 14:47:08,549 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:47:08,549 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000009 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:47:08,549 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000010 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:47:08,549 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000010 in state: RELEASED event:RELEASED
2015-02-12 14:47:08,549 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000010
2015-02-12 14:47:08,550 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:47:08,550 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000010 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:47:08,566 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0014_01_000009
2015-02-12 14:47:08,682 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741980_1156
2015-02-12 14:47:08,683 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154
2015-02-12 14:47:08,727 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153
2015-02-12 14:47:08,836 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0014_01_000010
2015-02-12 14:47:08,884 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153
2015-02-12 14:47:08,885 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155
2015-02-12 14:47:09,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741977_1153
2015-02-12 14:47:09,001 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741979_1155
2015-02-12 14:47:09,001 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741978_1154
2015-02-12 14:47:09,556 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 14:47:09,557 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:47:13,179 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157
2015-02-12 14:47:13,179 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158
2015-02-12 14:47:13,731 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158
2015-02-12 14:47:13,732 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157
2015-02-12 14:47:13,893 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741982_1158
2015-02-12 14:47:14,010 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741981_1157
2015-02-12 14:47:16,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:16,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:17,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:17,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:17,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:17,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:17,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:47:17,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:17,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:47:17,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:47:17,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:17,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:17,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:47:18,025 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:18,026 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000002
2015-02-12 14:47:18,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000002
2015-02-12 14:47:18,027 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:47:18,027 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000002
2015-02-12 14:47:18,051 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000002 is : 143
2015-02-12 14:47:18,052 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:18,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159 src: /127.0.0.1:52190 dest: /127.0.0.1:50543
2015-02-12 14:47:18,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159 src: /127.0.0.1:52191 dest: /127.0.0.1:50549
2015-02-12 14:47:18,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159 src: /127.0.0.1:52192 dest: /127.0.0.1:50546
2015-02-12 14:47:18,068 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:18,068 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist for DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:18,069 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000002
2015-02-12 14:47:18,069 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000002
2015-02-12 14:47:18,069 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000002
2015-02-12 14:47:18,069 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:18,070 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000002 from application application_1423780884992_0014
2015-02-12 14:47:18,070 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:18,070 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:18,069 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000002
2015-02-12 14:47:18,070 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000002
2015-02-12 14:47:18,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:47:18,208 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:18,210 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000005
2015-02-12 14:47:18,210 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000005
2015-02-12 14:47:18,210 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:47:18,210 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000005
2015-02-12 14:47:18,230 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000005 is : 143
2015-02-12 14:47:18,239 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:18,239 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000005
2015-02-12 14:47:18,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000005
2015-02-12 14:47:18,240 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000005
2015-02-12 14:47:18,240 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:18,241 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000005 from application application_1423780884992_0014
2015-02-12 14:47:18,241 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:18,241 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:18,241 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000005
2015-02-12 14:47:18,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000005
2015-02-12 14:47:18,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:47:18,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:47:18,307 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:18,308 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000003
2015-02-12 14:47:18,309 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000003
2015-02-12 14:47:18,309 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:47:18,309 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000003
2015-02-12 14:47:18,336 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000003 is : 143
2015-02-12 14:47:18,353 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:18,354 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000003
2015-02-12 14:47:18,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000003
2015-02-12 14:47:18,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000003
2015-02-12 14:47:18,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000003
2015-02-12 14:47:18,358 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000003
2015-02-12 14:47:18,358 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:18,359 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000003 from application application_1423780884992_0014
2015-02-12 14:47:18,359 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:18,359 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:18,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:47:18,368 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:18,371 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000006
2015-02-12 14:47:18,371 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000006
2015-02-12 14:47:18,372 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:47:18,372 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:18,373 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:47:18,373 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000002
2015-02-12 14:47:18,373 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:47:18,373 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000006
2015-02-12 14:47:18,373 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000002 on node: host: 10.1.1.67:50571 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:47:18,396 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000006 is : 143
2015-02-12 14:47:18,410 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:18,410 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000006
2015-02-12 14:47:18,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000006
2015-02-12 14:47:18,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000006
2015-02-12 14:47:18,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000006
2015-02-12 14:47:18,412 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000006
2015-02-12 14:47:18,412 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:18,412 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000006 from application application_1423780884992_0014
2015-02-12 14:47:18,413 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:18,413 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:18,420 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:18,421 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000007
2015-02-12 14:47:18,422 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000007
2015-02-12 14:47:18,422 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:47:18,422 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000007
2015-02-12 14:47:18,422 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:18,422 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:47:18,423 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000003
2015-02-12 14:47:18,423 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:47:18,423 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000003 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:47:18,444 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000007 is : 143
2015-02-12 14:47:18,461 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:18,462 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000007
2015-02-12 14:47:18,462 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000007
2015-02-12 14:47:18,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000007
2015-02-12 14:47:18,464 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000007
2015-02-12 14:47:18,465 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000007
2015-02-12 14:47:18,465 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:18,465 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000007 from application application_1423780884992_0014
2015-02-12 14:47:18,466 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:18,466 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:18,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:47:18,548 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:18,552 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000004
2015-02-12 14:47:18,553 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000004
2015-02-12 14:47:18,553 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:47:18,553 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000004
2015-02-12 14:47:18,578 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000004 is : 143
2015-02-12 14:47:18,584 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:18,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000004
2015-02-12 14:47:18,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000004
2015-02-12 14:47:18,586 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000004
2015-02-12 14:47:18,586 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:18,586 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000004 from application application_1423780884992_0014
2015-02-12 14:47:18,586 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:18,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000004
2015-02-12 14:47:18,587 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:18,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000004
2015-02-12 14:47:19,218 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:19,218 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:47:19,218 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000005
2015-02-12 14:47:19,218 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:19,219 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000005 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:19,376 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:19,376 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:19,377 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:47:19,377 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000006
2015-02-12 14:47:19,377 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:47:19,377 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:47:19,428 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:19,429 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:19,429 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:47:19,429 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000007
2015-02-12 14:47:19,429 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:19,429 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000007 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:19,557 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:19,557 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:47:19,557 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000004
2015-02-12 14:47:19,557 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:19,557 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:20,227 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:20,228 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:20,228 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000011
2015-02-12 14:47:20,228 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0014_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:20,382 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000002]
2015-02-12 14:47:20,382 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:20,382 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:20,439 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000003]
2015-02-12 14:47:20,439 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:20,439 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:20,567 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:20,623 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:20,635 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:20,637 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0014_01_000011 by user soberoi
2015-02-12 14:47:20,638 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000011
2015-02-12 14:47:20,638 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0014_01_000011 to application application_1423780884992_0014
2015-02-12 14:47:20,638 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000011 transitioned from NEW to LOCALIZING
2015-02-12 14:47:20,638 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0014
2015-02-12 14:47:20,638 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0014
2015-02-12 14:47:20,639 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:20,639 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0014
2015-02-12 14:47:20,639 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000011 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:20,679 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000011 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:20,679 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:20,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000011/default_container_executor.sh]
2015-02-12 14:47:21,234 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000005]
2015-02-12 14:47:21,234 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000011 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:21,234 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:21,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000006]
2015-02-12 14:47:21,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:21,448 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000007]
2015-02-12 14:47:21,448 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:21,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000004]
2015-02-12 14:47:21,577 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:21,634 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:47:23,310 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:23,313 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:23,318 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:23,320 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:23,328 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:23,332 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:23,497 INFO hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 14:47:23,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:47:23,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:47:23,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,506 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0008,submitTime=1423781071493,launchTime=1423781075698,firstMapTaskLaunchTime=1423781077950,firstReduceTaskLaunchTime=1423781090824,finishTime=1423781094047,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[3E9AC9D77F2F4953978740D284E1A487/DA0D6E8276F543D1BB6DE60F7B78917C] cogroupopt/(2/2)
2015-02-12 14:47:23,506 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0007,submitTime=1423781047378,launchTime=1423781051646,firstMapTaskLaunchTime=1423781053812,firstReduceTaskLaunchTime=1423781066735,finishTime=1423781069938,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[80C3A20AF1A948A68997C481C5D46FFA/0ED9A8A56B8147359D8BCD2900A4B8A0] cogroupopt/(1/2) ...tform/cogroupacogroupopt2
2015-02-12 14:47:23,506 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0009,submitTime=1423781095543,launchTime=1423781099596,firstMapTaskLaunchTime=1423781101759,firstReduceTaskLaunchTime=1423781114692,finishTime=1423781117857,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[3E9AC9D77F2F4953978740D284E1A487/D5BF53CC409946A7B2F6430D1CA3BCA5] cogroupopt/(1/2) ...tform/cogroupacogroupopt1
2015-02-12 14:47:23,506 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary]
2015-02-12 14:47:23,506 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary]
2015-02-12 14:47:23,506 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary]
2015-02-12 14:47:23,508 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741908_1084 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:47:23,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,508 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741919_1095 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:47:23,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,509 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741930_1106 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:47:23,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,511 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist
2015-02-12 14:47:23,511 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist
2015-02-12 14:47:23,512 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist
2015-02-12 14:47:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0007-1423781047378-soberoi-%5B80C3A20AF1A948A68997C481C5D46FFA%2F0ED9A8A56B814735-1423781069938-5-1-SUCCEEDED-root.soberoi-1423781051646.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0009-1423781095543-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FD5BF53CC409946A7-1423781117857-5-1-SUCCEEDED-root.soberoi-1423781099596.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,513 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0007_conf.xml
2015-02-12 14:47:23,514 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0009_conf.xml
2015-02-12 14:47:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0008-1423781071493-soberoi-%5B3E9AC9D77F2F4953978740D284E1A487%2FDA0D6E8276F543D1-1423781094047-5-1-SUCCEEDED-root.soberoi-1423781075698.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,514 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0008_conf.xml
2015-02-12 14:47:23,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0009_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0009_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0008_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0008_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0007_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0007_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,518 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0012,submitTime=1423781171183,launchTime=1423781175450,firstMapTaskLaunchTime=1423781177619,firstReduceTaskLaunchTime=1423781190558,finishTime=1423781193705,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[1DCDE7771A794C78A6EB2DDB2AC6C19C/04E744CB82324EB9B4870A93FB0DA514] lower*upper/(1/1) ...latform/cogroupinnerouter
2015-02-12 14:47:23,518 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary]
2015-02-12 14:47:23,518 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0010,submitTime=1423781119355,launchTime=1423781123530,firstMapTaskLaunchTime=1423781125719,firstReduceTaskLaunchTime=1423781140675,finishTime=1423781143820,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=76,reduceSlotSeconds=3,jobName=[5A65BCDD601C450BB697A96C6B6209A1/9705897B722B4BFC942904C4B8BC7C62] lower*upper1*upper2/(2/2)
2015-02-12 14:47:23,518 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary]
2015-02-12 14:47:23,519 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0011,submitTime=1423781145276,launchTime=1423781149301,firstMapTaskLaunchTime=1423781151499,firstReduceTaskLaunchTime=1423781166478,finishTime=1423781169683,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=73,reduceSlotSeconds=3,jobName=[5A65BCDD601C450BB697A96C6B6209A1/E2B7991778BA4551B6D54A4047BDC05A] lower*upper1*upper2/(1/2) ...splatform/cogroupacogroup
2015-02-12 14:47:23,519 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary]
2015-02-12 14:47:23,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741941_1117 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:47:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741952_1128 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:47:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741963_1139 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:47:23,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,523 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist
2015-02-12 14:47:23,523 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist
2015-02-12 14:47:23,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,524 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist
2015-02-12 14:47:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0010-1423781119355-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2F9705897B722B4BFC-1423781143820-6-1-SUCCEEDED-root.soberoi-1423781123530.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0011-1423781145276-soberoi-%5B5A65BCDD601C450BB697A96C6B6209A1%2FE2B7991778BA4551-1423781169683-6-1-SUCCEEDED-root.soberoi-1423781149301.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,524 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0010_conf.xml
2015-02-12 14:47:23,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0012-1423781171183-soberoi-%5B1DCDE7771A794C78A6EB2DDB2AC6C19C%2F04E744CB82324EB9-1423781193705-5-1-SUCCEEDED-root.soberoi-1423781175450.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,525 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0011_conf.xml
2015-02-12 14:47:23,525 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0012_conf.xml
2015-02-12 14:47:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0010_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0010_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0011_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0011_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0012_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0012_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,528 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0013,submitTime=1423781195222,launchTime=1423781199437,firstMapTaskLaunchTime=1423781201651,firstReduceTaskLaunchTime=1423781214597,finishTime=1423781217878,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[723A450D13BE46E797B2B9DC232B607D/C33B833ED08E40D89C69B175046E5EFE] lower*upper/(1/1) ...oupinnerouter-resultgroup
2015-02-12 14:47:23,529 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary]
2015-02-12 14:47:23,530 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741974_1150 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:47:23,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013.summary dst=null perm=null proto=rpc
2015-02-12 14:47:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,532 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist
2015-02-12 14:47:23,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0013-1423781195222-soberoi-%5B723A450D13BE46E797B2B9DC232B607D%2FC33B833ED08E40D8-1423781217878-5-1-SUCCEEDED-root.soberoi-1423781199437.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,534 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0013_conf.xml
2015-02-12 14:47:23,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0013_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0013_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:23,660 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:47:23,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160 src: /127.0.0.1:52214 dest: /127.0.0.1:50546
2015-02-12 14:47:23,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160 src: /127.0.0.1:52215 dest: /127.0.0.1:50539
2015-02-12 14:47:23,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160 src: /127.0.0.1:52216 dest: /127.0.0.1:50543
2015-02-12 14:47:23,796 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52216, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0014_r_000000_0_1660555973_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160, duration: 31300000
2015-02-12 14:47:23,797 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:23,797 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:47:23,798 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52215, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0014_r_000000_0_1660555973_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160, duration: 32883000
2015-02-12 14:47:23,798 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:23,799 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:23,800 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52214, dest: /127.0.0.1:50546, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0014_r_000000_0_1660555973_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160, duration: 34793000
2015-02-12 14:47:23,800 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:23,801 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:23,805 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0014_r_000000_0_1660555973_1
2015-02-12 14:47:23,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:47:23,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:47:23,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/task_1423780884992_0014_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1423780884992_0014_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/task_1423780884992_0014_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:47:23,851 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:23,855 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000011
2015-02-12 14:47:23,856 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000011
2015-02-12 14:47:23,856 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000011 transitioned from RUNNING to KILLING
2015-02-12 14:47:23,856 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000011
2015-02-12 14:47:23,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2015-02-12 14:47:23,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:23,870 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:23,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:47:23,882 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0014_01_000011 is : 143
2015-02-12 14:47:23,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:23,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:23,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/task_1423780884992_0014_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:23,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary/1/task_1423780884992_0014_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:23,896 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:23,897 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000011
2015-02-12 14:47:23,898 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000011
2015-02-12 14:47:23,898 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000011
2015-02-12 14:47:23,898 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000011
2015-02-12 14:47:23,899 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:23,899 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000011 from application application_1423780884992_0014
2015-02-12 14:47:23,899 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:23,899 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:23,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000011
2015-02-12 14:47:23,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary dst=null perm=null proto=rpc
2015-02-12 14:47:23,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:23,919 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_SUCCESS is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:23,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:23,925 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:23,945 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52192, dest: /127.0.0.1:50546, bytes: 75522, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159, duration: 5886248000
2015-02-12 14:47:23,946 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:23,947 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:47:23,950 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52191, dest: /127.0.0.1:50549, bytes: 75522, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159, duration: 5888528000
2015-02-12 14:47:23,951 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:23,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:47:23,953 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52190, dest: /127.0.0.1:50543, bytes: 75522, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159, duration: 5894175000
2015-02-12 14:47:23,953 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:23,954 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:47:23,955 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:23,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:23,963 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:23,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161 src: /127.0.0.1:52218 dest: /127.0.0.1:50549
2015-02-12 14:47:23,967 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161 src: /127.0.0.1:52219 dest: /127.0.0.1:50539
2015-02-12 14:47:23,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161 src: /127.0.0.1:52220 dest: /127.0.0.1:50546
2015-02-12 14:47:23,972 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52220, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161, duration: 1241000
2015-02-12 14:47:23,972 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:23,973 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:47:23,973 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52219, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161, duration: 2032000
2015-02-12 14:47:23,973 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:23,974 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52218, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161, duration: 3395000
2015-02-12 14:47:23,975 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:23,974 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:23,976 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:23,977 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary_tmp is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:23,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:23,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:47:23,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:23,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:47:23,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:23,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:47:23,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:24,006 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:24,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162 src: /127.0.0.1:52222 dest: /127.0.0.1:50539
2015-02-12 14:47:24,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162 src: /127.0.0.1:52223 dest: /127.0.0.1:50543
2015-02-12 14:47:24,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162 src: /127.0.0.1:52224 dest: /127.0.0.1:50546
2015-02-12 14:47:24,020 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52224, dest: /127.0.0.1:50546, bytes: 75522, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162, duration: 3222000
2015-02-12 14:47:24,020 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:24,022 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52223, dest: /127.0.0.1:50543, bytes: 75522, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162, duration: 4175000
2015-02-12 14:47:24,023 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:24,022 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:24,024 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52222, dest: /127.0.0.1:50539, bytes: 75522, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162, duration: 7980000
2015-02-12 14:47:24,025 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:24,026 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:24,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:24,028 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:24,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:24,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:47:24,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:24,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:47:24,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:24,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014/job_1423780884992_0014_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:47:24,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:24,044 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:47:24,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163 src: /127.0.0.1:52226 dest: /127.0.0.1:50546
2015-02-12 14:47:24,047 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163 src: /127.0.0.1:52227 dest: /127.0.0.1:50539
2015-02-12 14:47:24,049 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163 src: /127.0.0.1:52228 dest: /127.0.0.1:50549
2015-02-12 14:47:24,054 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52228, dest: /127.0.0.1:50549, bytes: 113901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163, duration: 2198000
2015-02-12 14:47:24,054 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:24,054 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:47:24,055 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52227, dest: /127.0.0.1:50539, bytes: 113901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163, duration: 2035000
2015-02-12 14:47:24,055 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:24,055 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:24,055 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52226, dest: /127.0.0.1:50546, bytes: 113901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_897374961_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163, duration: 2932000
2015-02-12 14:47:24,056 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:24,056 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:24,059 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_897374961_1
2015-02-12 14:47:24,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:24,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:24,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:24,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:24,083 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0014_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:47:24,083 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:47:24,083 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0014 with final state: FINISHING
2015-02-12 14:47:24,083 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from RUNNING to FINAL_SAVING
2015-02-12 14:47:24,083 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0014
2015-02-12 14:47:24,084 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:47:24,084 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from FINAL_SAVING to FINISHING
2015-02-12 14:47:24,867 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000011 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:24,867 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000011 in state: COMPLETED event:FINISHED
2015-02-12 14:47:24,867 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000011
2015-02-12 14:47:24,868 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:24,868 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000011 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:24,879 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741952_1128, blk_1073741974_1150, blk_1073741930_1106]
2015-02-12 14:47:24,879 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741908_1084, blk_1073741941_1117, blk_1073741974_1150, blk_1073741930_1106, blk_1073741963_1139, blk_1073741919_1095]
2015-02-12 14:47:25,092 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0014 unregistered successfully.
2015-02-12 14:47:25,096 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741977_1153 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:47:25,096 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741978_1154 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:47:25,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741979_1155 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:47:25,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741980_1156 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:47:25,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741982_1158 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:47:25,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741983_1159 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:47:25,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741981_1157 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:47:25,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0014 dst=null perm=null proto=rpc
2015-02-12 14:47:25,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,139 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary
2015-02-12 14:47:25,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/_temporary dst=null perm=null proto=rpc
2015-02-12 14:47:25,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,155 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:47:25,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:25,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,186 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:47:25,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:25,189 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/difffields
2015-02-12 14:47:25,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields dst=null perm=null proto=rpc
2015-02-12 14:47:25,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:25,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/difffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:25,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:25,209 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:47:25,210 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:47:25,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:25,222 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] starting
2015-02-12 14:47:25,223 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:47:25,223 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2"]
2015-02-12 14:47:25,223 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] parallel execution is enabled: true
2015-02-12 14:47:25,223 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] starting jobs: 1
2015-02-12 14:47:25,223 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] allocating threads: 1
2015-02-12 14:47:25,226 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] starting step: (1/1) ...edpipesplatform/samepipe2
2015-02-12 14:47:25,235 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:47:25,246 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:47:25,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:25,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:25,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:25,252 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 15
2015-02-12 14:47:25,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015 dst=null perm=null proto=rpc
2015-02-12 14:47:25,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:47:25,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:47:25,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,263 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:25,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 src: /127.0.0.1:52231 dest: /127.0.0.1:50543
2015-02-12 14:47:25,268 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 src: /127.0.0.1:52232 dest: /127.0.0.1:50549
2015-02-12 14:47:25,270 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 src: /127.0.0.1:52233 dest: /127.0.0.1:50546
2015-02-12 14:47:25,276 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52233, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164, duration: 3073000
2015-02-12 14:47:25,277 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:25,277 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,278 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52232, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164, duration: 4925000
2015-02-12 14:47:25,278 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,278 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52231, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164, duration: 5653000
2015-02-12 14:47:25,279 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,279 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,280 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,281 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:25,282 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar
2015-02-12 14:47:25,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:47:25,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:47:25,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:47:25,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:47:25,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:47:25,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:25,293 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:47:25,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:25,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,299 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split
2015-02-12 14:47:25,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:25,301 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:47:25,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165 src: /127.0.0.1:52234 dest: /127.0.0.1:50549
2015-02-12 14:47:25,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165 src: /127.0.0.1:52235 dest: /127.0.0.1:50539
2015-02-12 14:47:25,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165 src: /127.0.0.1:52236 dest: /127.0.0.1:50546
2015-02-12 14:47:25,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165 src: /127.0.0.1:52237 dest: /127.0.0.1:50543
2015-02-12 14:47:25,309 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52237, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, duration: 1281000
2015-02-12 14:47:25,309 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:25,310 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,310 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52236, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, duration: 1666000
2015-02-12 14:47:25,310 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,311 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,311 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52235, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, duration: 2775000
2015-02-12 14:47:25,312 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,313 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52234, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, duration: 4381000
2015-02-12 14:47:25,313 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,313 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,314 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,316 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:25,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,323 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:47:25,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166 src: /127.0.0.1:52238 dest: /127.0.0.1:50546
2015-02-12 14:47:25,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166 src: /127.0.0.1:52239 dest: /127.0.0.1:50549
2015-02-12 14:47:25,329 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166 src: /127.0.0.1:52240 dest: /127.0.0.1:50539
2015-02-12 14:47:25,334 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52240, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166, duration: 1967000
2015-02-12 14:47:25,334 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:25,334 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:47:25,335 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52239, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166, duration: 2037000
2015-02-12 14:47:25,335 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,336 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:47:25,337 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52238, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166, duration: 3851000
2015-02-12 14:47:25,338 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,343 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,345 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:25,346 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:47:25,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:25,358 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:47:25,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167 src: /127.0.0.1:52241 dest: /127.0.0.1:50549
2015-02-12 14:47:25,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167 src: /127.0.0.1:52242 dest: /127.0.0.1:50543
2015-02-12 14:47:25,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167 src: /127.0.0.1:52243 dest: /127.0.0.1:50546
2015-02-12 14:47:25,365 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52243, dest: /127.0.0.1:50546, bytes: 96673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167, duration: 1514000
2015-02-12 14:47:25,366 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:25,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,366 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52242, dest: /127.0.0.1:50543, bytes: 96673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167, duration: 2480000
2015-02-12 14:47:25,367 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,367 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52241, dest: /127.0.0.1:50549, bytes: 96673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167, duration: 3238000
2015-02-12 14:47:25,368 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,368 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:25,371 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:25,373 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:25,373 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0015
2015-02-12 14:47:25,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015 dst=null perm=null proto=rpc
2015-02-12 14:47:25,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:25,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:25,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:25,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:25,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:25,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:25,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,395 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 15 submitted by user soberoi
2015-02-12 14:47:25,395 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0015
2015-02-12 14:47:25,395 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from NEW to NEW_SAVING
2015-02-12 14:47:25,395 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0015
2015-02-12 14:47:25,395 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0015
2015-02-12 14:47:25,395 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:47:25,396 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0015 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:47:25,396 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from SUBMITTED to ACCEPTED
2015-02-12 14:47:25,396 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0015_000001
2015-02-12 14:47:25,396 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from NEW to SUBMITTED
2015-02-12 14:47:25,396 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0015_000001 to scheduler from user: soberoi
2015-02-12 14:47:25,397 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:47:25,397 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0015
2015-02-12 14:47:25,399 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0015/
2015-02-12 14:47:25,399 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] submitted hadoop job: job_1423780884992_0015
2015-02-12 14:47:25,399 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0015/
2015-02-12 14:47:25,417 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:25,417 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000001
2015-02-12 14:47:25,417 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:47:25,418 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0015_01_000001
2015-02-12 14:47:25,419 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:25,419 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0015_000001
2015-02-12 14:47:25,420 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0015 AttemptId: appattempt_1423780884992_0015_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0015_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:47:25,420 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:47:25,420 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:47:25,420 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0015_000001
2015-02-12 14:47:25,422 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0015_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0015_000001
2015-02-12 14:47:25,422 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0015_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:47:25,422 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0015_000001
2015-02-12 14:47:25,422 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0015_000001
2015-02-12 14:47:25,424 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:25,426 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000001 by user soberoi
2015-02-12 14:47:25,427 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0015
2015-02-12 14:47:25,427 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000001
2015-02-12 14:47:25,428 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from NEW to INITING
2015-02-12 14:47:25,428 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000001 to application application_1423780884992_0015
2015-02-12 14:47:25,428 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from INITING to RUNNING
2015-02-12 14:47:25,428 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0015_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0015_000001
2015-02-12 14:47:25,429 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:47:25,429 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:47:25,429 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:25,430 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:25,430 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:47:25,430 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:47:25,430 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:25,431 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0015_01_000001
2015-02-12 14:47:25,444 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0015_01_000001.tokens. Credentials list:
2015-02-12 14:47:25,563 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:25,648 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0015_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000001.tokens
2015-02-12 14:47:25,648 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:25,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:25,762 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0015/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:25,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:25,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:25,830 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:25,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:25,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:25,874 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:25,893 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:25,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:25,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:25,955 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0015/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:25,956 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:25,996 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:25,996 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:26,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741952 for deletion
2015-02-12 14:47:26,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741974 for deletion
2015-02-12 14:47:26,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741930 for deletion
2015-02-12 14:47:26,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741952
2015-02-12 14:47:26,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741930
2015-02-12 14:47:26,102 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741974
2015-02-12 14:47:26,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000001/default_container_executor.sh]
2015-02-12 14:47:26,366 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741908 for deletion
2015-02-12 14:47:26,366 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741941 for deletion
2015-02-12 14:47:26,366 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741974 for deletion
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741908
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741930 for deletion
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741941
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741974
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741963 for deletion
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741919 for deletion
2015-02-12 14:47:26,367 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741930
2015-02-12 14:47:26,368 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741963
2015-02-12 14:47:26,368 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741919
2015-02-12 14:47:26,419 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:26,877 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:27,881 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:27,885 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50543 to replicate blk_1073741988_1164 to datanode(s) 127.0.0.1:50539
2015-02-12 14:47:27,885 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741952_1128, blk_1073741963_1139, blk_1073741908_1084, blk_1073741941_1117, blk_1073741974_1150, blk_1073741977_1153, blk_1073741978_1154, blk_1073741979_1155, blk_1073741980_1156, blk_1073741981_1157, blk_1073741982_1158, blk_1073741919_1095, blk_1073741983_1159]
2015-02-12 14:47:27,885 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741977_1153, blk_1073741978_1154, blk_1073741979_1155, blk_1073741981_1157, blk_1073741983_1159]
2015-02-12 14:47:27,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:27,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:47:27,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:47:27,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:47:28,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015 dst=null perm=null proto=rpc
2015-02-12 14:47:28,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:47:28,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:47:28,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:28,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:28,753 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 to 127.0.0.1:50539
2015-02-12 14:47:28,754 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741952 for deletion
2015-02-12 14:47:28,754 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741963 for deletion
2015-02-12 14:47:28,754 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741908 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741941 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741974 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741979 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741980_1156 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741980 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741981_1157 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741981 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741982 for deletion
2015-02-12 14:47:28,755 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741952
2015-02-12 14:47:28,756 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741963
2015-02-12 14:47:28,756 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741941
2015-02-12 14:47:28,756 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977
2015-02-12 14:47:28,757 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:47:28,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741979
2015-02-12 14:47:28,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741981_1157 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741981
2015-02-12 14:47:28,756 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741919 for deletion
2015-02-12 14:47:28,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741983_1159 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741983 for deletion
2015-02-12 14:47:28,756 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741908
2015-02-12 14:47:28,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741919
2015-02-12 14:47:28,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741983_1159 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741983
2015-02-12 14:47:28,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741974
2015-02-12 14:47:28,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978
2015-02-12 14:47:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741980_1156 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741980
2015-02-12 14:47:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741982
2015-02-12 14:47:28,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 src: /127.0.0.1:52251 dest: /127.0.0.1:50539
2015-02-12 14:47:28,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164 src: /127.0.0.1:52251 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:47:28,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741988_1164 size 254067
2015-02-12 14:47:28,891 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:28,916 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160
2015-02-12 14:47:29,035 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161
2015-02-12 14:47:29,035 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741983_1159
2015-02-12 14:47:29,337 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:29,338 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0015_000001
2015-02-12 14:47:29,339 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0015 APPATTEMPTID=appattempt_1423780884992_0015_000001
2015-02-12 14:47:29,339 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:47:29,339 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from ACCEPTED to RUNNING
2015-02-12 14:47:29,373 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977 for deletion
2015-02-12 14:47:29,373 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978 for deletion
2015-02-12 14:47:29,373 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741979 for deletion
2015-02-12 14:47:29,374 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741981_1157 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741981 for deletion
2015-02-12 14:47:29,374 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741983_1159 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741983 for deletion
2015-02-12 14:47:29,376 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977
2015-02-12 14:47:29,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741979
2015-02-12 14:47:29,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741983_1159 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741983
2015-02-12 14:47:29,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978
2015-02-12 14:47:29,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741981_1157 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741981
2015-02-12 14:47:29,426 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 1342 Total time for transactions(ms): 126 Number of transactions batched in Syncs: 7 Number of syncs: 922 SyncTimes(ms): 318 211
2015-02-12 14:47:29,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:29,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:47:29,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:29,773 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:47:29,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168 src: /127.0.0.1:52255 dest: /127.0.0.1:50546
2015-02-12 14:47:29,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168 src: /127.0.0.1:52256 dest: /127.0.0.1:50549
2015-02-12 14:47:29,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168 src: /127.0.0.1:52257 dest: /127.0.0.1:50539
2015-02-12 14:47:29,869 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52257, dest: /127.0.0.1:50539, bytes: 113388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168, duration: 39544000
2015-02-12 14:47:29,869 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:29,870 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52256, dest: /127.0.0.1:50549, bytes: 113388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168, duration: 40788000
2015-02-12 14:47:29,871 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:29,870 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:47:29,873 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:47:29,873 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52255, dest: /127.0.0.1:50546, bytes: 113388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168, duration: 42984000
2015-02-12 14:47:29,873 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:29,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:47:29,883 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:29,892 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:29,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:29,920 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:47:29,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169 src: /127.0.0.1:52258 dest: /127.0.0.1:50549
2015-02-12 14:47:29,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169 src: /127.0.0.1:52259 dest: /127.0.0.1:50543
2015-02-12 14:47:29,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169 src: /127.0.0.1:52260 dest: /127.0.0.1:50546
2015-02-12 14:47:29,933 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52260, dest: /127.0.0.1:50546, bytes: 389, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169, duration: 1766000
2015-02-12 14:47:29,933 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:29,933 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:29,934 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52259, dest: /127.0.0.1:50543, bytes: 389, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169, duration: 2492000
2015-02-12 14:47:29,934 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:29,935 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52258, dest: /127.0.0.1:50549, bytes: 389, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169, duration: 3685000
2015-02-12 14:47:29,935 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:29,935 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:29,936 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:29,941 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015.summary is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:30,251 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0014_01_000001 succeeded
2015-02-12 14:47:30,251 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:47:30,251 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0014_01_000001
2015-02-12 14:47:30,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000001
2015-02-12 14:47:30,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000001
2015-02-12 14:47:30,265 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000001
2015-02-12 14:47:30,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000001
2015-02-12 14:47:30,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014/container_1423780884992_0014_01_000001
2015-02-12 14:47:30,265 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0014_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:47:30,265 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0014_01_000001 from application application_1423780884992_0014
2015-02-12 14:47:30,266 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:30,266 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0014
2015-02-12 14:47:30,453 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0014_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:30,453 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0014_000001
2015-02-12 14:47:30,453 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0014_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:47:30,453 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000001
2015-02-12 14:47:30,453 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0014_000001
2015-02-12 14:47:30,454 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0014_000001 State change from FINISHING to FINISHED
2015-02-12 14:47:30,454 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0014 State change from FINISHING to FINISHED
2015-02-12 14:47:30,453 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0014_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:47:30,454 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0014_000001 released container container_1423780884992_0014_01_000001 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:47:30,455 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0014
2015-02-12 14:47:30,455 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:30,454 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0014_000001
2015-02-12 14:47:30,455 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000002
2015-02-12 14:47:30,456 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:47:30,456 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0014_000001 is done. finalState=FINISHED
2015-02-12 14:47:30,455 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0014,name=[C5A8FAF0C94E40EFA5284C67EE2607A8/05F829A76A4D4AB4BE7844842E33747E] lower*upper/(1/1) ...dpipesplatform/difffields,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0014/jobhistory/job/job_1423780884992_0014,appMasterHost=10.1.1.67,startTime=1423781219393,finishTime=1423781244083,finalStatus=SUCCEEDED
2015-02-12 14:47:30,456 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0014 requests cleared
2015-02-12 14:47:30,458 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0014_000001 (auth:SIMPLE)
2015-02-12 14:47:30,459 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0014_01_000001
2015-02-12 14:47:30,459 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0014 CONTAINERID=container_1423780884992_0014_01_000001
2015-02-12 14:47:30,460 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0014_01_000001]
2015-02-12 14:47:30,460 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:30,460 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:30,460 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:30,461 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,461 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000003
2015-02-12 14:47:30,461 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,461 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,461 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0014
2015-02-12 14:47:30,461 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:30,461 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0014, with delay of 10800 seconds
2015-02-12 14:47:30,461 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:47:30,462 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,499 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:30,499 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:30,499 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000004
2015-02-12 14:47:30,499 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:30,499 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,500 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,500 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,500 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,500 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0014
2015-02-12 14:47:30,501 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:30,501 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0014, with delay of 10800 seconds
2015-02-12 14:47:30,633 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:30,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:30,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,633 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000005
2015-02-12 14:47:30,634 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0014
2015-02-12 14:47:30,635 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:30,635 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0014, with delay of 10800 seconds
2015-02-12 14:47:30,634 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:30,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,888 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741977_1153, blk_1073741978_1154, blk_1073741980_1156, blk_1073741981_1157, blk_1073741982_1158, blk_1073741983_1159]
2015-02-12 14:47:30,888 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741952_1128, blk_1073741908_1084, blk_1073741941_1117, blk_1073741977_1153, blk_1073741978_1154, blk_1073741930_1106, blk_1073741979_1155, blk_1073741963_1139, blk_1073741980_1156, blk_1073741982_1158, blk_1073741919_1095]
2015-02-12 14:47:30,894 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:30,894 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:30,895 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:30,895 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000006
2015-02-12 14:47:30,895 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:30,896 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0014
2015-02-12 14:47:30,896 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,896 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:30,896 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0014, with delay of 10800 seconds
2015-02-12 14:47:30,896 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:30,896 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0014
2015-02-12 14:47:31,386 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0015_01_000002
2015-02-12 14:47:31,386 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:31,386 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:31,387 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0015_01_000004
2015-02-12 14:47:31,387 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:31,388 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0015_01_000005
2015-02-12 14:47:31,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:31,388 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0015_01_000006
2015-02-12 14:47:31,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:31,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:31,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:31,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:31,538 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:31,539 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:31,540 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:31,538 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:31,541 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:31,544 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000003 by user soberoi
2015-02-12 14:47:31,545 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000003
2015-02-12 14:47:31,545 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000003 to application application_1423780884992_0015
2015-02-12 14:47:31,545 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:47:31,545 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,545 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,545 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:31,545 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0015
2015-02-12 14:47:31,544 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000005 by user soberoi
2015-02-12 14:47:31,546 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0015
2015-02-12 14:47:31,546 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000005
2015-02-12 14:47:31,547 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from NEW to INITING
2015-02-12 14:47:31,546 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:31,547 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000005 to application application_1423780884992_0015
2015-02-12 14:47:31,547 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from INITING to RUNNING
2015-02-12 14:47:31,545 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000002 by user soberoi
2015-02-12 14:47:31,547 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:47:31,547 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000002
2015-02-12 14:47:31,548 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000002 to application application_1423780884992_0015
2015-02-12 14:47:31,548 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:47:31,547 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,549 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,549 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:31,549 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0015
2015-02-12 14:47:31,549 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:31,549 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:31,549 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0015_01_000005
2015-02-12 14:47:31,548 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,550 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,550 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:31,550 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0015
2015-02-12 14:47:31,551 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000006 by user soberoi
2015-02-12 14:47:31,551 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:31,551 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0015
2015-02-12 14:47:31,552 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000006
2015-02-12 14:47:31,553 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000004 by user soberoi
2015-02-12 14:47:31,553 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0015
2015-02-12 14:47:31,553 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000004
2015-02-12 14:47:31,554 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from NEW to INITING
2015-02-12 14:47:31,554 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000006 to application application_1423780884992_0015
2015-02-12 14:47:31,554 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from INITING to RUNNING
2015-02-12 14:47:31,554 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:47:31,555 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,555 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,555 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:31,555 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0015
2015-02-12 14:47:31,555 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:31,555 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:31,555 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0015_01_000006
2015-02-12 14:47:31,556 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from NEW to INITING
2015-02-12 14:47:31,556 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000004 to application application_1423780884992_0015
2015-02-12 14:47:31,557 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from INITING to RUNNING
2015-02-12 14:47:31,557 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:47:31,557 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,557 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0015
2015-02-12 14:47:31,557 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:31,557 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0015
2015-02-12 14:47:31,558 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:31,558 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:31,558 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0015_01_000004
2015-02-12 14:47:31,597 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0015_01_000005.tokens. Credentials list:
2015-02-12 14:47:31,598 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0015_01_000006.tokens. Credentials list:
2015-02-12 14:47:31,605 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0015_01_000004.tokens. Credentials list:
2015-02-12 14:47:31,623 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:31,624 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:31,637 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:31,638 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:31,638 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741952 for deletion
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741908 for deletion
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741941 for deletion
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977 for deletion
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741930 for deletion
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741952
2015-02-12 14:47:31,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741908
2015-02-12 14:47:31,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977
2015-02-12 14:47:31,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741941
2015-02-12 14:47:31,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741930
2015-02-12 14:47:31,757 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978 for deletion
2015-02-12 14:47:31,758 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741963 for deletion
2015-02-12 14:47:31,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741979 for deletion
2015-02-12 14:47:31,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741980_1156 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741980 for deletion
2015-02-12 14:47:31,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978
2015-02-12 14:47:31,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741980_1156 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741980
2015-02-12 14:47:31,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741982 for deletion
2015-02-12 14:47:31,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741919 for deletion
2015-02-12 14:47:31,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741963
2015-02-12 14:47:31,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741979
2015-02-12 14:47:31,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741982
2015-02-12 14:47:31,761 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741919
2015-02-12 14:47:31,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:31,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:31,901 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:31,902 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:31,902 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:31,921 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000002/default_container_executor.sh]
2015-02-12 14:47:31,942 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000003/default_container_executor.sh]
2015-02-12 14:47:32,102 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0015_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000006.tokens
2015-02-12 14:47:32,102 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0015_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000005.tokens
2015-02-12 14:47:32,102 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:32,103 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:32,110 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977 for deletion
2015-02-12 14:47:32,110 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978 for deletion
2015-02-12 14:47:32,110 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741980_1156 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741980 for deletion
2015-02-12 14:47:32,110 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741981_1157 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741981 for deletion
2015-02-12 14:47:32,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741982 for deletion
2015-02-12 14:47:32,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741983_1159 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741983 for deletion
2015-02-12 14:47:32,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741980_1156 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741980
2015-02-12 14:47:32,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741977_1153 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741977
2015-02-12 14:47:32,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741981_1157 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741981
2015-02-12 14:47:32,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741978_1154 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741978
2015-02-12 14:47:32,112 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741983_1159 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741983
2015-02-12 14:47:32,112 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741982
2015-02-12 14:47:32,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0015_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000004.tokens
2015-02-12 14:47:32,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:32,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:32,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:32,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:32,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:32,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:32,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:32,390 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0015/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:32,396 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0015/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:32,398 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0015/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:32,399 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:47:32,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:32,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:32,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:32,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:32,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:32,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:32,476 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:32,476 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:32,506 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:32,511 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0015/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:32,511 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:32,511 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0015/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:32,511 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:32,530 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0015/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:32,530 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:32,571 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:32,571 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:32,571 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:32,571 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:32,580 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:32,580 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:32,750 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000006/default_container_executor.sh]
2015-02-12 14:47:32,759 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000005/default_container_executor.sh]
2015-02-12 14:47:32,759 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000004/default_container_executor.sh]
2015-02-12 14:47:33,212 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167
2015-02-12 14:47:33,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160
2015-02-12 14:47:33,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164
2015-02-12 14:47:33,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165
2015-02-12 14:47:33,414 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162
2015-02-12 14:47:33,765 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165
2015-02-12 14:47:33,765 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166
2015-02-12 14:47:33,766 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741984_1160
2015-02-12 14:47:33,767 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167
2015-02-12 14:47:33,767 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161
2015-02-12 14:47:33,768 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163
2015-02-12 14:47:33,924 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162
2015-02-12 14:47:33,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166
2015-02-12 14:47:33,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165
2015-02-12 14:47:33,926 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163
2015-02-12 14:47:33,927 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741985_1161
2015-02-12 14:47:33,969 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741986_1162
2015-02-12 14:47:34,042 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741987_1163
2015-02-12 14:47:34,043 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741991_1167
2015-02-12 14:47:34,131 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164
2015-02-12 14:47:34,171 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164
2015-02-12 14:47:34,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741988_1164
2015-02-12 14:47:34,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741989_1165
2015-02-12 14:47:34,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741990_1166
2015-02-12 14:47:38,421 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169
2015-02-12 14:47:39,139 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168
2015-02-12 14:47:39,177 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169
2015-02-12 14:47:39,178 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168
2015-02-12 14:47:39,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741992_1168
2015-02-12 14:47:39,251 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741993_1169
2015-02-12 14:47:39,560 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 14:47:39,560 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:47:41,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:42,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:42,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:42,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:42,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:42,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:42,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:42,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:42,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:42,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:43,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:47:43,112 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:43,115 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000003
2015-02-12 14:47:43,115 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000003
2015-02-12 14:47:43,115 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:47:43,116 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000003
2015-02-12 14:47:43,145 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0015_01_000003 is : 143
2015-02-12 14:47:43,153 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:47:43,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170 src: /127.0.0.1:52298 dest: /127.0.0.1:50549
2015-02-12 14:47:43,163 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170 src: /127.0.0.1:52299 dest: /127.0.0.1:50546
2015-02-12 14:47:43,166 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170 src: /127.0.0.1:52300 dest: /127.0.0.1:50543
2015-02-12 14:47:43,167 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:43,171 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000003
2015-02-12 14:47:43,178 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000003
2015-02-12 14:47:43,179 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:43,179 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000003 from application application_1423780884992_0015
2015-02-12 14:47:43,179 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:43,179 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:43,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000003
2015-02-12 14:47:43,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000003
2015-02-12 14:47:43,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000003
2015-02-12 14:47:43,187 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist for DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:43,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:47:43,254 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:43,256 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000002
2015-02-12 14:47:43,257 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000002
2015-02-12 14:47:43,257 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:47:43,257 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000002
2015-02-12 14:47:43,260 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:43,260 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:47:43,260 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000003
2015-02-12 14:47:43,260 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:47:43,261 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000003 on node: host: 10.1.1.67:50571 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:47:43,282 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0015_01_000002 is : 143
2015-02-12 14:47:43,298 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:43,301 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000002
2015-02-12 14:47:43,302 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000002
2015-02-12 14:47:43,302 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000002
2015-02-12 14:47:43,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000002
2015-02-12 14:47:43,303 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000002
2015-02-12 14:47:43,304 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:43,304 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000002 from application application_1423780884992_0015
2015-02-12 14:47:43,304 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:43,305 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:43,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:47:43,509 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:43,511 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000006
2015-02-12 14:47:43,511 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000006
2015-02-12 14:47:43,511 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:47:43,511 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000006
2015-02-12 14:47:43,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:47:43,533 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0015_01_000006 is : 143
2015-02-12 14:47:43,544 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:43,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000006
2015-02-12 14:47:43,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000006
2015-02-12 14:47:43,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000006
2015-02-12 14:47:43,546 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000006
2015-02-12 14:47:43,546 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000006
2015-02-12 14:47:43,546 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:43,547 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000006 from application application_1423780884992_0015
2015-02-12 14:47:43,547 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:43,548 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:43,565 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:43,568 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000005
2015-02-12 14:47:43,568 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000005
2015-02-12 14:47:43,568 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:47:43,568 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000005
2015-02-12 14:47:43,589 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0015_01_000005 is : 143
2015-02-12 14:47:43,599 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:43,599 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000005
2015-02-12 14:47:43,599 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000005
2015-02-12 14:47:43,600 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000005
2015-02-12 14:47:43,600 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000005
2015-02-12 14:47:43,600 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000005
2015-02-12 14:47:43,600 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:43,600 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000005 from application application_1423780884992_0015
2015-02-12 14:47:43,600 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:43,601 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:43,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:47:43,670 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:43,677 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000004
2015-02-12 14:47:43,677 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000004
2015-02-12 14:47:43,678 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:47:43,678 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000004
2015-02-12 14:47:43,705 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0015_01_000004 is : 143
2015-02-12 14:47:43,712 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:43,713 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000004
2015-02-12 14:47:43,714 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:43,714 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000004 from application application_1423780884992_0015
2015-02-12 14:47:43,714 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:43,714 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:43,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000004
2015-02-12 14:47:43,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000004
2015-02-12 14:47:43,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000004
2015-02-12 14:47:43,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000004
2015-02-12 14:47:44,264 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:44,264 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:47:44,264 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000002
2015-02-12 14:47:44,264 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:47:44,264 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000002 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:47:44,265 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:44,515 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:44,516 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:47:44,516 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000006
2015-02-12 14:47:44,516 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:44,516 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000006 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:44,516 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:44,517 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000007
2015-02-12 14:47:44,517 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0015_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:44,571 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:44,571 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:47:44,572 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000005
2015-02-12 14:47:44,572 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:44,572 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000005 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:44,684 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:44,684 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:47:44,684 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000004
2015-02-12 14:47:44,684 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:44,685 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:45,265 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0015_01_000003]
2015-02-12 14:47:45,265 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:45,265 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:45,444 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:45,455 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:45,457 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0015_01_000007 by user soberoi
2015-02-12 14:47:45,457 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000007
2015-02-12 14:47:45,457 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0015_01_000007 to application application_1423780884992_0015
2015-02-12 14:47:45,457 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:47:45,458 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0015
2015-02-12 14:47:45,458 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0015
2015-02-12 14:47:45,458 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:45,458 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0015
2015-02-12 14:47:45,458 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:45,488 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:45,489 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:45,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:45,519 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:45,574 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:45,599 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000007/default_container_executor.sh]
2015-02-12 14:47:45,685 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:46,266 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0015_01_000002]
2015-02-12 14:47:46,266 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:46,448 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:47:46,520 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0015_01_000006]
2015-02-12 14:47:46,521 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:46,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0015_01_000005]
2015-02-12 14:47:46,576 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:46,690 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0015_01_000004]
2015-02-12 14:47:46,690 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:48,056 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:48,060 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:48,063 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:48,065 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:48,075 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:47:48,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,333 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:47:48,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171 src: /127.0.0.1:52326 dest: /127.0.0.1:50546
2015-02-12 14:47:48,438 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171 src: /127.0.0.1:52327 dest: /127.0.0.1:50543
2015-02-12 14:47:48,440 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171 src: /127.0.0.1:52328 dest: /127.0.0.1:50549
2015-02-12 14:47:48,482 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52328, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0015_r_000000_0_1817464166_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171, duration: 39766000
2015-02-12 14:47:48,483 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:48,484 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52327, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0015_r_000000_0_1817464166_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171, duration: 41198000
2015-02-12 14:47:48,484 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,486 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52326, dest: /127.0.0.1:50546, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0015_r_000000_0_1817464166_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171, duration: 43165000
2015-02-12 14:47:48,486 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,486 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,488 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,489 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,494 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0015_r_000000_0_1817464166_1
2015-02-12 14:47:48,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:47:48,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:47:48,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/task_1423780884992_0015_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:47:48,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1423780884992_0015_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/task_1423780884992_0015_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:47:48,538 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:48,540 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000007
2015-02-12 14:47:48,540 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000007
2015-02-12 14:47:48,541 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:47:48,541 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000007
2015-02-12 14:47:48,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,561 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:47:48,573 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0015_01_000007 is : 143
2015-02-12 14:47:48,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:48,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:48,586 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:47:48,587 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000007
2015-02-12 14:47:48,587 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:47:48,587 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000007 from application application_1423780884992_0015
2015-02-12 14:47:48,587 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:48,588 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:48,588 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000007
2015-02-12 14:47:48,589 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000007
2015-02-12 14:47:48,589 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000007
2015-02-12 14:47:48,589 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000007
2015-02-12 14:47:48,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/task_1423780884992_0015_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:47:48,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:48,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary/1/task_1423780884992_0015_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary dst=null perm=null proto=rpc
2015-02-12 14:47:48,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,614 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,620 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,641 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52300, dest: /127.0.0.1:50543, bytes: 68427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170, duration: 5472935000
2015-02-12 14:47:48,642 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:48,647 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52299, dest: /127.0.0.1:50546, bytes: 68427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170, duration: 5475754000
2015-02-12 14:47:48,647 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16373
2015-02-12 14:47:48,648 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,649 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52298, dest: /127.0.0.1:50549, bytes: 68427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170, duration: 5480291000
2015-02-12 14:47:48,649 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,652 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,653 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741994_1170 size 68427
2015-02-12 14:47:48,654 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741994_1170 size 68427
2015-02-12 14:47:48,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,660 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:47:48,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172 src: /127.0.0.1:52330 dest: /127.0.0.1:50543
2015-02-12 14:47:48,664 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172 src: /127.0.0.1:52331 dest: /127.0.0.1:50539
2015-02-12 14:47:48,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172 src: /127.0.0.1:52332 dest: /127.0.0.1:50546
2015-02-12 14:47:48,670 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52332, dest: /127.0.0.1:50546, bytes: 449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172, duration: 1657000
2015-02-12 14:47:48,670 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:48,674 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52331, dest: /127.0.0.1:50539, bytes: 449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172, duration: 5401000
2015-02-12 14:47:48,674 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,675 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:47:48,676 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,676 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52330, dest: /127.0.0.1:50543, bytes: 449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172, duration: 7796000
2015-02-12 14:47:48,677 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,679 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,683 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:48,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:47:48,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:48,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:47:48,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:48,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:47:48,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,714 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:48,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173 src: /127.0.0.1:52334 dest: /127.0.0.1:50549
2015-02-12 14:47:48,718 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173 src: /127.0.0.1:52335 dest: /127.0.0.1:50543
2015-02-12 14:47:48,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173 src: /127.0.0.1:52336 dest: /127.0.0.1:50546
2015-02-12 14:47:48,725 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52336, dest: /127.0.0.1:50546, bytes: 68427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173, duration: 3715000
2015-02-12 14:47:48,725 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:48,726 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:47:48,726 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52335, dest: /127.0.0.1:50543, bytes: 68427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173, duration: 4438000
2015-02-12 14:47:48,726 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,727 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:47:48,727 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52334, dest: /127.0.0.1:50549, bytes: 68427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173, duration: 5246000
2015-02-12 14:47:48,727 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,728 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,730 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:48,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:47:48,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:48,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:47:48,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:47:48,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015/job_1423780884992_0015_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:47:48,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:48,751 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:47:48,754 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174 src: /127.0.0.1:52338 dest: /127.0.0.1:50549
2015-02-12 14:47:48,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174 src: /127.0.0.1:52339 dest: /127.0.0.1:50546
2015-02-12 14:47:48,757 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174 src: /127.0.0.1:52340 dest: /127.0.0.1:50539
2015-02-12 14:47:48,760 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52340, dest: /127.0.0.1:50539, bytes: 113388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174, duration: 1965000
2015-02-12 14:47:48,760 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:48,761 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,761 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52339, dest: /127.0.0.1:50546, bytes: 113388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174, duration: 2690000
2015-02-12 14:47:48,761 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,762 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,762 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52338, dest: /127.0.0.1:50549, bytes: 113388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1152836133_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174, duration: 3730000
2015-02-12 14:47:48,762 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:48,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:48,765 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1152836133_1
2015-02-12 14:47:48,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:48,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:48,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:48,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:47:48,790 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0015_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:47:48,790 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:47:48,790 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0015 with final state: FINISHING
2015-02-12 14:47:48,790 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from RUNNING to FINAL_SAVING
2015-02-12 14:47:48,791 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0015
2015-02-12 14:47:48,791 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:47:48,791 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from FINAL_SAVING to FINISHING
2015-02-12 14:47:49,546 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:49,547 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:47:49,547 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000007
2015-02-12 14:47:49,547 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:47:49,547 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000007 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:47:49,796 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0015 unregistered successfully.
2015-02-12 14:47:49,800 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741988_1164 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:47:49,800 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741989_1165 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:47:49,801 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741990_1166 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:47:49,801 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741991_1167 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:47:49,801 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741993_1169 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:47:49,802 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741994_1170 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:47:49,802 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741992_1168 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:47:49,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0015 dst=null perm=null proto=rpc
2015-02-12 14:47:49,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,836 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary
2015-02-12 14:47:49,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/_temporary dst=null perm=null proto=rpc
2015-02-12 14:47:49,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,855 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:47:49,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:49,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,875 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:47:49,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:49,878 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2
2015-02-12 14:47:49,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2 dst=null perm=null proto=rpc
2015-02-12 14:47:49,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:49,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:47:49,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:49,902 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:47:49,902 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:47:49,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:47:49,912 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] starting
2015-02-12 14:47:49,913 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:47:49,913 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3"]
2015-02-12 14:47:49,913 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] parallel execution is enabled: true
2015-02-12 14:47:49,913 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] starting jobs: 1
2015-02-12 14:47:49,913 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] allocating threads: 1
2015-02-12 14:47:49,915 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs] starting step: (1/1) ...edpipesplatform/samepipe3
2015-02-12 14:47:49,929 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:47:50,074 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:47:50,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:47:50,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:50,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:50,080 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 16
2015-02-12 14:47:50,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016 dst=null perm=null proto=rpc
2015-02-12 14:47:50,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:47:50,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:47:50,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,088 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:50,089 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 src: /127.0.0.1:52346 dest: /127.0.0.1:50549
2015-02-12 14:47:50,091 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 src: /127.0.0.1:52347 dest: /127.0.0.1:50539
2015-02-12 14:47:50,092 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 src: /127.0.0.1:52348 dest: /127.0.0.1:50546
2015-02-12 14:47:50,096 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52348, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175, duration: 2122000
2015-02-12 14:47:50,096 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:50,096 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:47:50,097 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52347, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175, duration: 2755000
2015-02-12 14:47:50,097 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,097 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:47:50,097 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52346, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175, duration: 3577000
2015-02-12 14:47:50,098 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,099 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:50,100 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:50,101 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar
2015-02-12 14:47:50,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:47:50,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:47:50,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:47:50,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:47:50,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:47:50,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:50,109 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:47:50,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:47:50,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,117 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split
2015-02-12 14:47:50,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:50,118 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:47:50,121 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176 src: /127.0.0.1:52349 dest: /127.0.0.1:50546
2015-02-12 14:47:50,123 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176 src: /127.0.0.1:52350 dest: /127.0.0.1:50549
2015-02-12 14:47:50,124 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176 src: /127.0.0.1:52351 dest: /127.0.0.1:50539
2015-02-12 14:47:50,125 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176 src: /127.0.0.1:52352 dest: /127.0.0.1:50543
2015-02-12 14:47:50,128 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52352, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, duration: 2139000
2015-02-12 14:47:50,129 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:50,129 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:50,129 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52351, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, duration: 2403000
2015-02-12 14:47:50,129 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,130 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:50,130 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52350, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, duration: 3522000
2015-02-12 14:47:50,130 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,131 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:50,131 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52349, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, duration: 3909000
2015-02-12 14:47:50,131 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,135 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742000_1176 size 1787
2015-02-12 14:47:50,135 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:50,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,141 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:47:50,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177 src: /127.0.0.1:52353 dest: /127.0.0.1:50546
2015-02-12 14:47:50,146 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177 src: /127.0.0.1:52354 dest: /127.0.0.1:50543
2015-02-12 14:47:50,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177 src: /127.0.0.1:52355 dest: /127.0.0.1:50539
2015-02-12 14:47:50,151 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52355, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177, duration: 1181000
2015-02-12 14:47:50,151 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:50,152 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:47:50,152 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52354, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177, duration: 1938000
2015-02-12 14:47:50,152 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:47:50,153 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52353, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177, duration: 2862000
2015-02-12 14:47:50,154 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,156 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:47:50,157 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:50,158 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:47:50,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:47:50,166 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:47:50,168 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178 src: /127.0.0.1:52356 dest: /127.0.0.1:50543
2015-02-12 14:47:50,170 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178 src: /127.0.0.1:52357 dest: /127.0.0.1:50539
2015-02-12 14:47:50,171 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178 src: /127.0.0.1:52358 dest: /127.0.0.1:50549
2015-02-12 14:47:50,174 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52358, dest: /127.0.0.1:50549, bytes: 96867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178, duration: 1770000
2015-02-12 14:47:50,174 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:50,175 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:47:50,175 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52357, dest: /127.0.0.1:50539, bytes: 96867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178, duration: 2269000
2015-02-12 14:47:50,176 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,177 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52356, dest: /127.0.0.1:50543, bytes: 96867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178, duration: 3815000
2015-02-12 14:47:50,177 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:50,177 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:50,178 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:50,179 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:47:50,180 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0016
2015-02-12 14:47:50,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016 dst=null perm=null proto=rpc
2015-02-12 14:47:50,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:50,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:50,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:50,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:50,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:50,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:50,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,212 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 16 submitted by user soberoi
2015-02-12 14:47:50,212 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0016
2015-02-12 14:47:50,212 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0016
2015-02-12 14:47:50,212 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0016
2015-02-12 14:47:50,212 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from NEW to NEW_SAVING
2015-02-12 14:47:50,213 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:47:50,213 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0016 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:47:50,213 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from SUBMITTED to ACCEPTED
2015-02-12 14:47:50,213 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0016_000001
2015-02-12 14:47:50,213 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from NEW to SUBMITTED
2015-02-12 14:47:50,213 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0016_000001 to scheduler from user: soberoi
2015-02-12 14:47:50,214 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:47:50,215 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0016
2015-02-12 14:47:50,217 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0016/
2015-02-12 14:47:50,217 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs] submitted hadoop job: job_1423780884992_0016
2015-02-12 14:47:50,217 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0016/
2015-02-12 14:47:50,285 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:50,285 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000001
2015-02-12 14:47:50,285 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:47:50,286 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0016_01_000001
2015-02-12 14:47:50,286 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:50,286 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0016_000001
2015-02-12 14:47:50,286 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0016 AttemptId: appattempt_1423780884992_0016_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0016_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:47:50,286 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:47:50,287 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:47:50,287 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0016_000001
2015-02-12 14:47:50,288 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0016_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0016_000001
2015-02-12 14:47:50,288 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0016_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:47:50,288 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0016_000001
2015-02-12 14:47:50,288 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0016_000001
2015-02-12 14:47:50,291 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:50,292 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000001 by user soberoi
2015-02-12 14:47:50,293 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0016
2015-02-12 14:47:50,293 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000001
2015-02-12 14:47:50,293 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from NEW to INITING
2015-02-12 14:47:50,293 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000001 to application application_1423780884992_0016
2015-02-12 14:47:50,293 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from INITING to RUNNING
2015-02-12 14:47:50,294 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:47:50,294 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0016_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0016_000001
2015-02-12 14:47:50,294 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:47:50,294 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:47:50,294 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:50,294 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:47:50,294 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:47:50,294 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:50,295 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0016_01_000001
2015-02-12 14:47:50,308 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0016_01_000001.tokens. Credentials list:
2015-02-12 14:47:50,426 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:50,522 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0016_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000001.tokens
2015-02-12 14:47:50,523 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:47:50,547 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:50,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:50,657 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0016/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:50,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:50,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:50,722 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0016/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:50,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:50,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:47:50,792 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0016/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:50,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:50,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:50,859 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:50,859 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:50,899 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:50,899 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:51,007 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000001/default_container_executor.sh]
2015-02-12 14:47:51,287 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:51,551 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:51,913 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073741999_1175 to datanode(s) 127.0.0.1:50543
2015-02-12 14:47:51,913 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166, blk_1073741991_1167, blk_1073741992_1168, blk_1073741993_1169, blk_1073741994_1170]
2015-02-12 14:47:51,913 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166, blk_1073741992_1168]
2015-02-12 14:47:52,553 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:52,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988 for deletion
2015-02-12 14:47:52,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989 for deletion
2015-02-12 14:47:52,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741990 for deletion
2015-02-12 14:47:52,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988
2015-02-12 14:47:52,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741992 for deletion
2015-02-12 14:47:52,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741990
2015-02-12 14:47:52,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989
2015-02-12 14:47:52,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741992
2015-02-12 14:47:52,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:47:52,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:47:52,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:47:52,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:47:53,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016 dst=null perm=null proto=rpc
2015-02-12 14:47:53,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:47:53,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:47:53,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988 for deletion
2015-02-12 14:47:53,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989 for deletion
2015-02-12 14:47:53,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741990 for deletion
2015-02-12 14:47:53,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741991 for deletion
2015-02-12 14:47:53,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741992 for deletion
2015-02-12 14:47:53,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741993 for deletion
2015-02-12 14:47:53,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741994_1170 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741994 for deletion
2015-02-12 14:47:53,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988
2015-02-12 14:47:53,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741990
2015-02-12 14:47:53,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741992
2015-02-12 14:47:53,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741994_1170 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741994
2015-02-12 14:47:53,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989
2015-02-12 14:47:53,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741991
2015-02-12 14:47:53,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741993
2015-02-12 14:47:53,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:53,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:47:53,396 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 to 127.0.0.1:50543
2015-02-12 14:47:53,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 src: /127.0.0.1:52364 dest: /127.0.0.1:50543
2015-02-12 14:47:53,398 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:47:53,399 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175 src: /127.0.0.1:52364 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:47:53,399 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073741999_1175 size 254067
2015-02-12 14:47:53,556 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:54,157 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174
2015-02-12 14:47:54,157 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172
2015-02-12 14:47:54,195 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173
2015-02-12 14:47:54,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172
2015-02-12 14:47:54,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171
2015-02-12 14:47:54,197 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174
2015-02-12 14:47:54,263 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741994_1170
2015-02-12 14:47:54,264 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171
2015-02-12 14:47:54,265 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173
2015-02-12 14:47:54,341 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:54,343 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0016_000001
2015-02-12 14:47:54,343 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0016 APPATTEMPTID=appattempt_1423780884992_0016_000001
2015-02-12 14:47:54,343 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:47:54,344 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from ACCEPTED to RUNNING
2015-02-12 14:47:54,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:54,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:47:54,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741998_1174
2015-02-12 14:47:54,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:54,560 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:54,774 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:47:54,822 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179 src: /127.0.0.1:52371 dest: /127.0.0.1:50539
2015-02-12 14:47:54,824 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179 src: /127.0.0.1:52372 dest: /127.0.0.1:50546
2015-02-12 14:47:54,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179 src: /127.0.0.1:52373 dest: /127.0.0.1:50543
2015-02-12 14:47:54,862 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52373, dest: /127.0.0.1:50543, bytes: 113582, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179, duration: 34764000
2015-02-12 14:47:54,862 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:54,862 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:54,863 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52372, dest: /127.0.0.1:50546, bytes: 113582, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179, duration: 35560000
2015-02-12 14:47:54,863 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:54,864 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52371, dest: /127.0.0.1:50539, bytes: 113582, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179, duration: 36635000
2015-02-12 14:47:54,864 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:54,864 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:54,864 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:54,872 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1_conf.xml is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:47:54,879 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0015_01_000001 succeeded
2015-02-12 14:47:54,880 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:47:54,880 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0015_01_000001
2015-02-12 14:47:54,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000001
2015-02-12 14:47:54,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000001
2015-02-12 14:47:54,907 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000001
2015-02-12 14:47:54,908 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0015/container_1423780884992_0015_01_000001
2015-02-12 14:47:54,908 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000001
2015-02-12 14:47:54,909 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0015_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:47:54,910 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0015_01_000001 from application application_1423780884992_0015
2015-02-12 14:47:54,910 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:54,910 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0015
2015-02-12 14:47:54,918 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166, blk_1073741991_1167, blk_1073741992_1168, blk_1073741993_1169, blk_1073741994_1170]
2015-02-12 14:47:54,918 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073741988_1164, blk_1073741989_1165, blk_1073741991_1167, blk_1073741993_1169, blk_1073741994_1170]
2015-02-12 14:47:54,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:47:54,922 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:47:54,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180 src: /127.0.0.1:52374 dest: /127.0.0.1:50549
2015-02-12 14:47:54,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180 src: /127.0.0.1:52375 dest: /127.0.0.1:50539
2015-02-12 14:47:54,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180 src: /127.0.0.1:52376 dest: /127.0.0.1:50546
2015-02-12 14:47:54,941 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52376, dest: /127.0.0.1:50546, bytes: 387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180, duration: 9300000
2015-02-12 14:47:54,941 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:47:54,943 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52375, dest: /127.0.0.1:50539, bytes: 387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180, duration: 11148000
2015-02-12 14:47:54,943 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:47:54,943 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:54,944 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:54,944 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52374, dest: /127.0.0.1:50549, bytes: 387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180, duration: 12267000
2015-02-12 14:47:54,944 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:47:54,945 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:47:54,946 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016.summary is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:47:55,298 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0015_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:47:55,298 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0015_000001
2015-02-12 14:47:55,298 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0015_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:47:55,298 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0015_000001
2015-02-12 14:47:55,299 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000001
2015-02-12 14:47:55,299 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0015_000001 State change from FINISHING to FINISHED
2015-02-12 14:47:55,299 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0015_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:47:55,299 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0015 State change from FINISHING to FINISHED
2015-02-12 14:47:55,299 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0015_000001 released container container_1423780884992_0015_01_000001 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:47:55,300 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0015_000001
2015-02-12 14:47:55,300 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0015
2015-02-12 14:47:55,300 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0015,name=[D6A2E4E25CA14DF4B9B13582ED0223E1/C3710DC4068645748772690322E8BC4C] lower/(1/1) ...edpipesplatform/samepipe2,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0015/jobhistory/job/job_1423780884992_0015,appMasterHost=10.1.1.67,startTime=1423781245395,finishTime=1423781268790,finalStatus=SUCCEEDED
2015-02-12 14:47:55,300 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0015_000001 is done. finalState=FINISHED
2015-02-12 14:47:55,301 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0015 requests cleared
2015-02-12 14:47:55,302 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0015_000001 (auth:SIMPLE)
2015-02-12 14:47:55,304 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0015_01_000001
2015-02-12 14:47:55,304 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0015 CONTAINERID=container_1423780884992_0015_01_000001
2015-02-12 14:47:55,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0015_01_000001]
2015-02-12 14:47:55,305 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:55,305 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:55,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,306 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0015
2015-02-12 14:47:55,306 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,306 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:55,306 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0015, with delay of 10800 seconds
2015-02-12 14:47:55,307 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,307 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,563 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:55,563 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:55,564 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:55,564 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000002
2015-02-12 14:47:55,564 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:55,564 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,565 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0015
2015-02-12 14:47:55,564 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,565 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:55,565 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0015, with delay of 10800 seconds
2015-02-12 14:47:55,565 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,610 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:55,610 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:55,611 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000003
2015-02-12 14:47:55,611 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:55,611 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0015
2015-02-12 14:47:55,611 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:55,611 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0015, with delay of 10800 seconds
2015-02-12 14:47:55,612 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,612 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,613 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,613 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,714 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:47:55,714 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:55,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,716 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0015
2015-02-12 14:47:55,716 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:47:55,716 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0015, with delay of 10800 seconds
2015-02-12 14:47:55,714 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000004
2015-02-12 14:47:55,716 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:47:55,716 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0015
2015-02-12 14:47:55,784 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988 for deletion
2015-02-12 14:47:55,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989 for deletion
2015-02-12 14:47:55,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741991 for deletion
2015-02-12 14:47:55,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741993 for deletion
2015-02-12 14:47:55,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741994_1170 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741994 for deletion
2015-02-12 14:47:55,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988
2015-02-12 14:47:55,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989
2015-02-12 14:47:55,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741991
2015-02-12 14:47:55,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741993
2015-02-12 14:47:55,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741994_1170 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741994
2015-02-12 14:47:56,306 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:56,306 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000005
2015-02-12 14:47:56,307 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:47:56,399 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0016_01_000002
2015-02-12 14:47:56,399 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988 for deletion
2015-02-12 14:47:56,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989 for deletion
2015-02-12 14:47:56,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741990 for deletion
2015-02-12 14:47:56,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741991 for deletion
2015-02-12 14:47:56,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741992 for deletion
2015-02-12 14:47:56,400 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:56,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741989
2015-02-12 14:47:56,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741993 for deletion
2015-02-12 14:47:56,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741991
2015-02-12 14:47:56,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741988
2015-02-12 14:47:56,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741993
2015-02-12 14:47:56,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741994_1170 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741994 for deletion
2015-02-12 14:47:56,401 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0016_01_000003
2015-02-12 14:47:56,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741990
2015-02-12 14:47:56,402 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:56,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741992
2015-02-12 14:47:56,403 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0016_01_000004
2015-02-12 14:47:56,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:56,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741994_1170 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741994
2015-02-12 14:47:56,403 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0016_01_000005
2015-02-12 14:47:56,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:56,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:56,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:56,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:47:56,558 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:56,561 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:56,562 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000004 by user soberoi
2015-02-12 14:47:56,563 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0016
2015-02-12 14:47:56,563 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:56,563 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000004
2015-02-12 14:47:56,563 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from NEW to INITING
2015-02-12 14:47:56,563 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000004 to application application_1423780884992_0016
2015-02-12 14:47:56,563 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from INITING to RUNNING
2015-02-12 14:47:56,564 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:47:56,564 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:47:56,564 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,564 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,564 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:56,564 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:56,564 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000006
2015-02-12 14:47:56,564 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:47:56,564 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0016
2015-02-12 14:47:56,565 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:56,565 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:56,565 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000003 by user soberoi
2015-02-12 14:47:56,565 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0016
2015-02-12 14:47:56,565 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0016_01_000004
2015-02-12 14:47:56,565 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000003
2015-02-12 14:47:56,566 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from NEW to INITING
2015-02-12 14:47:56,566 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000003 to application application_1423780884992_0016
2015-02-12 14:47:56,566 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from INITING to RUNNING
2015-02-12 14:47:56,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:47:56,566 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,566 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,566 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:56,567 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0016
2015-02-12 14:47:56,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:56,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:56,567 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0016_01_000003
2015-02-12 14:47:56,567 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000005 by user soberoi
2015-02-12 14:47:56,567 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000005
2015-02-12 14:47:56,568 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000005 to application application_1423780884992_0016
2015-02-12 14:47:56,569 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:47:56,569 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,569 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,569 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:56,569 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0016
2015-02-12 14:47:56,570 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:56,591 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0016_01_000003.tokens. Credentials list:
2015-02-12 14:47:56,591 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0016_01_000004.tokens. Credentials list:
2015-02-12 14:47:56,594 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:56,613 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000002 by user soberoi
2015-02-12 14:47:56,613 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0016
2015-02-12 14:47:56,613 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000002
2015-02-12 14:47:56,614 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from NEW to INITING
2015-02-12 14:47:56,614 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000002 to application application_1423780884992_0016
2015-02-12 14:47:56,614 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from INITING to RUNNING
2015-02-12 14:47:56,614 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:47:56,614 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,614 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0016
2015-02-12 14:47:56,614 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:56,615 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0016
2015-02-12 14:47:56,615 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:47:56,615 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:47:56,615 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0016_01_000002
2015-02-12 14:47:56,616 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:56,638 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0016_01_000002.tokens. Credentials list:
2015-02-12 14:47:56,650 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:56,650 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:56,715 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:56,821 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:56,829 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:56,850 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:47:56,890 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000005/default_container_executor.sh]
2015-02-12 14:47:56,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0016_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000004.tokens
2015-02-12 14:47:56,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:47:57,016 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0016_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000003.tokens
2015-02-12 14:47:57,018 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:47:57,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0016_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000002.tokens
2015-02-12 14:47:57,049 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:47:57,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:57,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:57,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:57,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:57,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:57,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar dst=null perm=null proto=rpc
2015-02-12 14:47:57,253 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0016/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:57,274 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0016/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:57,289 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:57,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:57,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:57,307 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:57,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:57,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:57,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:57,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml dst=null perm=null proto=rpc
2015-02-12 14:47:57,365 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0016/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:57,365 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:57,393 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0016/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:57,393 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:57,412 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0016/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:47:57,412 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:57,416 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:57,427 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:57,427 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:57,433 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:47:57,436 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000006 by user soberoi
2015-02-12 14:47:57,436 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000006
2015-02-12 14:47:57,436 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000006 to application application_1423780884992_0016
2015-02-12 14:47:57,436 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:47:57,436 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:47:57,436 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0016
2015-02-12 14:47:57,436 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:47:57,437 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0016
2015-02-12 14:47:57,437 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:47:57,473 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:57,473 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:57,491 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:57,492 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:57,505 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:47:57,505 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:47:57,569 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:57,569 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:47:57,570 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:47:57,570 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000007
2015-02-12 14:47:57,570 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:47:57,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000004/default_container_executor.sh]
2015-02-12 14:47:57,712 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000002/default_container_executor.sh]
2015-02-12 14:47:57,713 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000003/default_container_executor.sh]
2015-02-12 14:47:57,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000006/default_container_executor.sh]
2015-02-12 14:47:58,421 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:47:58,421 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:47:58,429 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741997_1173
2015-02-12 14:47:58,430 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178
2015-02-12 14:47:58,631 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175
2015-02-12 14:47:58,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176
2015-02-12 14:47:58,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741995_1171
2015-02-12 14:47:58,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741996_1172
2015-02-12 14:47:58,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177
2015-02-12 14:47:59,163 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177
2015-02-12 14:47:59,164 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178
2015-02-12 14:47:59,368 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175
2015-02-12 14:47:59,368 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176
2015-02-12 14:47:59,407 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175
2015-02-12 14:47:59,407 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176
2015-02-12 14:47:59,408 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742001_1177
2015-02-12 14:47:59,424 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:47:59,424 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:47:59,424 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000007
2015-02-12 14:47:59,424 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:47:59,424 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000007 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:47:59,474 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073741999_1175
2015-02-12 14:47:59,475 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742002_1178
2015-02-12 14:47:59,475 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742000_1176
2015-02-12 14:47:59,577 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0016_01_000007
2015-02-12 14:48:03,636 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179
2015-02-12 14:48:04,374 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180
2015-02-12 14:48:04,375 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179
2015-02-12 14:48:04,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742003_1179
2015-02-12 14:48:04,414 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180
2015-02-12 14:48:04,481 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742004_1180
2015-02-12 14:48:05,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:06,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:06,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:06,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:06,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:06,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:06,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:06,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:06,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:06,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:06,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:48:06,831 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:06,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000005
2015-02-12 14:48:06,834 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000005
2015-02-12 14:48:06,834 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:48:06,834 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000005
2015-02-12 14:48:06,855 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:48:06,856 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0016_01_000005 is : 143
2015-02-12 14:48:06,862 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181 src: /127.0.0.1:52414 dest: /127.0.0.1:50543
2015-02-12 14:48:06,864 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181 src: /127.0.0.1:52415 dest: /127.0.0.1:50549
2015-02-12 14:48:06,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181 src: /127.0.0.1:52416 dest: /127.0.0.1:50539
2015-02-12 14:48:06,867 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:06,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000005
2015-02-12 14:48:06,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000005
2015-02-12 14:48:06,869 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000005
2015-02-12 14:48:06,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000005
2015-02-12 14:48:06,869 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:06,871 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000005 from application application_1423780884992_0016
2015-02-12 14:48:06,871 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:06,871 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:06,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000005
2015-02-12 14:48:06,876 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist for DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:07,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:48:07,033 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:07,035 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000006
2015-02-12 14:48:07,035 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000006
2015-02-12 14:48:07,036 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:48:07,036 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000006
2015-02-12 14:48:07,055 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0016_01_000006 is : 143
2015-02-12 14:48:07,064 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:07,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000006
2015-02-12 14:48:07,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000006
2015-02-12 14:48:07,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000006
2015-02-12 14:48:07,065 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000006
2015-02-12 14:48:07,065 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:07,065 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000006 from application application_1423780884992_0016
2015-02-12 14:48:07,066 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000006
2015-02-12 14:48:07,067 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:07,068 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:07,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:48:07,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:07,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:48:07,118 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:07,120 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000002
2015-02-12 14:48:07,120 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000002
2015-02-12 14:48:07,121 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:07,121 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:48:07,121 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000006
2015-02-12 14:48:07,121 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:48:07,121 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000006 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:48:07,121 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:48:07,121 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000002
2015-02-12 14:48:07,148 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0016_01_000002 is : 143
2015-02-12 14:48:07,174 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:07,174 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:07,175 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000004
2015-02-12 14:48:07,176 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000004
2015-02-12 14:48:07,176 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:48:07,176 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000004
2015-02-12 14:48:07,177 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000003
2015-02-12 14:48:07,177 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000003
2015-02-12 14:48:07,178 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:48:07,178 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000003
2015-02-12 14:48:07,186 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:07,205 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0016_01_000003 is : 143
2015-02-12 14:48:07,215 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0016_01_000004 is : 143
2015-02-12 14:48:07,218 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:07,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000004
2015-02-12 14:48:07,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000004
2015-02-12 14:48:07,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000004
2015-02-12 14:48:07,219 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000004
2015-02-12 14:48:07,220 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:07,220 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000004 from application application_1423780884992_0016
2015-02-12 14:48:07,220 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:07,220 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:07,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000004
2015-02-12 14:48:07,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000002
2015-02-12 14:48:07,222 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000002
2015-02-12 14:48:07,223 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000002
2015-02-12 14:48:07,224 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000002
2015-02-12 14:48:07,225 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000002
2015-02-12 14:48:07,225 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:07,226 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000002 from application application_1423780884992_0016
2015-02-12 14:48:07,226 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:07,226 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:07,227 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:07,227 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000003
2015-02-12 14:48:07,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000003
2015-02-12 14:48:07,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000003
2015-02-12 14:48:07,229 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000003
2015-02-12 14:48:07,231 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000003
2015-02-12 14:48:07,231 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:07,231 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000003 from application application_1423780884992_0016
2015-02-12 14:48:07,232 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:07,232 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:07,838 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:07,838 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:48:07,838 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000005
2015-02-12 14:48:07,838 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:48:07,838 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000005 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:48:08,122 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:08,122 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:48:08,123 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000002
2015-02-12 14:48:08,123 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:08,123 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000002 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:08,123 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:08,181 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:08,181 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:48:08,182 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000004
2015-02-12 14:48:08,182 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:08,182 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:08,183 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:08,183 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:48:08,183 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000003
2015-02-12 14:48:08,183 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:08,183 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000003 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:08,838 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:08,839 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:08,839 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000008
2015-02-12 14:48:08,839 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0016_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:48:09,127 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0016_01_000006]
2015-02-12 14:48:09,127 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:09,127 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:09,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:09,187 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:09,469 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:09,479 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:09,482 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0016_01_000008 by user soberoi
2015-02-12 14:48:09,482 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000008
2015-02-12 14:48:09,482 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0016_01_000008 to application application_1423780884992_0016
2015-02-12 14:48:09,483 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:48:09,483 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0016
2015-02-12 14:48:09,483 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0016
2015-02-12 14:48:09,483 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:09,483 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0016
2015-02-12 14:48:09,484 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:09,515 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:09,515 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:09,565 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:48:09,566 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:48:09,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000008/default_container_executor.sh]
2015-02-12 14:48:09,841 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0016_01_000005]
2015-02-12 14:48:09,842 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:09,842 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:10,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0016_01_000002]
2015-02-12 14:48:10,132 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:10,187 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0016_01_000004]
2015-02-12 14:48:10,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0016_01_000003]
2015-02-12 14:48:10,188 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:10,188 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:10,475 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:48:12,342 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:12,346 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:12,350 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:12,352 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:12,358 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:12,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:12,617 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:48:12,721 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182 src: /127.0.0.1:52430 dest: /127.0.0.1:50549
2015-02-12 14:48:12,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182 src: /127.0.0.1:52431 dest: /127.0.0.1:50543
2015-02-12 14:48:12,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182 src: /127.0.0.1:52432 dest: /127.0.0.1:50539
2015-02-12 14:48:12,768 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52432, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0016_r_000000_0_-1431821195_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182, duration: 43056000
2015-02-12 14:48:12,768 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:12,769 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:48:12,769 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52431, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0016_r_000000_0_-1431821195_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182, duration: 43803000
2015-02-12 14:48:12,769 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:12,770 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52430, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0016_r_000000_0_-1431821195_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182, duration: 44890000
2015-02-12 14:48:12,770 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:12,771 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:48:12,772 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:48:12,776 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0016_r_000000_0_-1431821195_1
2015-02-12 14:48:12,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:12,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:12,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/task_1423780884992_0016_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:48:12,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1423780884992_0016_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/task_1423780884992_0016_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:48:12,833 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:12,837 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000008
2015-02-12 14:48:12,837 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000008
2015-02-12 14:48:12,838 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:48:12,838 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000008
2015-02-12 14:48:12,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:12,859 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:12,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:48:12,870 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0016_01_000008 is : 143
2015-02-12 14:48:12,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:12,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:12,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/task_1423780884992_0016_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:48:12,884 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:12,886 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000008
2015-02-12 14:48:12,887 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000008
2015-02-12 14:48:12,887 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:12,887 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000008 from application application_1423780884992_0016
2015-02-12 14:48:12,887 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:12,887 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:12,887 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000008
2015-02-12 14:48:12,887 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000008
2015-02-12 14:48:12,887 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000008
2015-02-12 14:48:12,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:12,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary/1/task_1423780884992_0016_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:12,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary dst=null perm=null proto=rpc
2015-02-12 14:48:12,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:12,908 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_SUCCESS is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:12,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:12,914 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:12,939 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52416, dest: /127.0.0.1:50539, bytes: 68429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181, duration: 6068419000
2015-02-12 14:48:12,940 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:12,941 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16360
2015-02-12 14:48:12,941 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52415, dest: /127.0.0.1:50549, bytes: 68429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181, duration: 6068297000
2015-02-12 14:48:12,942 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:12,943 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16360
2015-02-12 14:48:12,943 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52414, dest: /127.0.0.1:50543, bytes: 68429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181, duration: 6070734000
2015-02-12 14:48:12,944 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:12,944 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16360
2015-02-12 14:48:12,946 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:12,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:12,952 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:48:12,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183 src: /127.0.0.1:52434 dest: /127.0.0.1:50549
2015-02-12 14:48:12,956 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183 src: /127.0.0.1:52435 dest: /127.0.0.1:50539
2015-02-12 14:48:12,959 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183 src: /127.0.0.1:52436 dest: /127.0.0.1:50543
2015-02-12 14:48:12,964 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52436, dest: /127.0.0.1:50543, bytes: 447, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183, duration: 2248000
2015-02-12 14:48:12,965 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:12,965 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:48:12,965 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52435, dest: /127.0.0.1:50539, bytes: 447, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183, duration: 2544000
2015-02-12 14:48:12,966 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:12,966 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:12,966 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52434, dest: /127.0.0.1:50549, bytes: 447, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183, duration: 3702000
2015-02-12 14:48:12,967 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:12,967 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:12,970 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary_tmp is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:12,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:12,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:48:12,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:12,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:48:12,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:12,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:48:12,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:13,004 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:48:13,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184 src: /127.0.0.1:52438 dest: /127.0.0.1:50546
2015-02-12 14:48:13,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184 src: /127.0.0.1:52439 dest: /127.0.0.1:50539
2015-02-12 14:48:13,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184 src: /127.0.0.1:52440 dest: /127.0.0.1:50549
2015-02-12 14:48:13,017 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52440, dest: /127.0.0.1:50549, bytes: 68429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184, duration: 3183000
2015-02-12 14:48:13,017 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:13,018 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52439, dest: /127.0.0.1:50539, bytes: 68429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184, duration: 2415000
2015-02-12 14:48:13,018 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:13,018 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:13,019 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52438, dest: /127.0.0.1:50546, bytes: 68429, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184, duration: 3692000
2015-02-12 14:48:13,019 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:13,019 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:13,020 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:13,022 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:13,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:13,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:48:13,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:13,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:48:13,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:13,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016/job_1423780884992_0016_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:48:13,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:13,049 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:48:13,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185 src: /127.0.0.1:52442 dest: /127.0.0.1:50546
2015-02-12 14:48:13,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185 src: /127.0.0.1:52443 dest: /127.0.0.1:50549
2015-02-12 14:48:13,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185 src: /127.0.0.1:52444 dest: /127.0.0.1:50543
2015-02-12 14:48:13,062 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52444, dest: /127.0.0.1:50543, bytes: 113582, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185, duration: 3646000
2015-02-12 14:48:13,062 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:13,062 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:13,063 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52443, dest: /127.0.0.1:50549, bytes: 113582, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185, duration: 4292000
2015-02-12 14:48:13,063 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:13,063 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52442, dest: /127.0.0.1:50546, bytes: 113582, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239911535_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185, duration: 5373000
2015-02-12 14:48:13,064 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:13,064 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:13,065 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:13,068 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_239911535_1
2015-02-12 14:48:13,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:13,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:13,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:13,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:13,102 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0016_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:48:13,103 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:48:13,103 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0016 with final state: FINISHING
2015-02-12 14:48:13,104 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from RUNNING to FINAL_SAVING
2015-02-12 14:48:13,104 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0016
2015-02-12 14:48:13,106 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:48:13,107 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from FINAL_SAVING to FINISHING
2015-02-12 14:48:13,840 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:13,840 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:48:13,840 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000008
2015-02-12 14:48:13,841 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:48:13,841 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000008 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:48:14,109 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0016 unregistered successfully.
2015-02-12 14:48:14,113 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741999_1175 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:48:14,113 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742000_1176 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:48:14,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742001_1177 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:48:14,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742002_1178 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:48:14,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742004_1180 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:48:14,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742005_1181 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:48:14,114 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742003_1179 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:48:14,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0016 dst=null perm=null proto=rpc
2015-02-12 14:48:14,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,153 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary
2015-02-12 14:48:14,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/_temporary dst=null perm=null proto=rpc
2015-02-12 14:48:14,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,167 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:14,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:14,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,184 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:14,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:14,190 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3
2015-02-12 14:48:14,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3 dst=null perm=null proto=rpc
2015-02-12 14:48:14,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:14,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:14,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,206 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:48:14,207 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186 src: /127.0.0.1:52448 dest: /127.0.0.1:50546
2015-02-12 14:48:14,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186 src: /127.0.0.1:52449 dest: /127.0.0.1:50549
2015-02-12 14:48:14,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186 src: /127.0.0.1:52450 dest: /127.0.0.1:50539
2015-02-12 14:48:14,214 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52450, dest: /127.0.0.1:50539, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186, duration: 1844000
2015-02-12 14:48:14,214 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:14,215 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52449, dest: /127.0.0.1:50549, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186, duration: 2607000
2015-02-12 14:48:14,216 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,217 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52448, dest: /127.0.0.1:50546, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186, duration: 4144000
2015-02-12 14:48:14,217 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,217 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,219 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,219 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,220 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:14,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,224 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt. BP-1595598241-10.1.1.67-1423780868362 blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:48:14,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187 src: /127.0.0.1:52451 dest: /127.0.0.1:50546
2015-02-12 14:48:14,229 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187 src: /127.0.0.1:52452 dest: /127.0.0.1:50539
2015-02-12 14:48:14,231 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187 src: /127.0.0.1:52453 dest: /127.0.0.1:50549
2015-02-12 14:48:14,233 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52453, dest: /127.0.0.1:50549, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187, duration: 1302000
2015-02-12 14:48:14,234 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:14,234 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:48:14,234 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52452, dest: /127.0.0.1:50539, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187, duration: 1882000
2015-02-12 14:48:14,235 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:48:14,236 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52451, dest: /127.0.0.1:50546, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187, duration: 3583000
2015-02-12 14:48:14,238 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,239 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,243 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:14,260 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:48:14,261 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:48:14,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:14,273 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting
2015-02-12 14:48:14,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-02-12 14:48:14,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-02-12 14:48:14,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross"]
2015-02-12 14:48:14,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] parallel execution is enabled: true
2015-02-12 14:48:14,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting jobs: 1
2015-02-12 14:48:14,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] allocating threads: 1
2015-02-12 14:48:14,275 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (1/1) ...ieldedpipesplatform/cross
2015-02-12 14:48:14,291 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:48:14,306 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:48:14,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:14,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:48:14,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:48:14,315 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 17
2015-02-12 14:48:14,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017 dst=null perm=null proto=rpc
2015-02-12 14:48:14,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:48:14,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:48:14,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,325 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:48:14,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 src: /127.0.0.1:52455 dest: /127.0.0.1:50546
2015-02-12 14:48:14,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 src: /127.0.0.1:52456 dest: /127.0.0.1:50543
2015-02-12 14:48:14,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 src: /127.0.0.1:52457 dest: /127.0.0.1:50549
2015-02-12 14:48:14,336 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52457, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188, duration: 2483000
2015-02-12 14:48:14,336 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:14,337 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:48:14,337 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52456, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188, duration: 3349000
2015-02-12 14:48:14,339 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,341 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:48:14,341 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52455, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188, duration: 6559000
2015-02-12 14:48:14,343 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,345 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:48:14,347 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:14,347 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar
2015-02-12 14:48:14,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:48:14,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:48:14,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:48:14,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:48:14,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:48:14,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,362 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:14,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,366 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:14,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,368 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:14,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,371 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:14,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:14,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,381 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split
2015-02-12 14:48:14,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:14,383 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:48:14,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189 src: /127.0.0.1:52458 dest: /127.0.0.1:50543
2015-02-12 14:48:14,386 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189 src: /127.0.0.1:52459 dest: /127.0.0.1:50539
2015-02-12 14:48:14,388 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189 src: /127.0.0.1:52460 dest: /127.0.0.1:50549
2015-02-12 14:48:14,389 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189 src: /127.0.0.1:52461 dest: /127.0.0.1:50546
2015-02-12 14:48:14,393 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52461, dest: /127.0.0.1:50546, bytes: 1777, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, duration: 2377000
2015-02-12 14:48:14,394 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:14,396 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,397 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52460, dest: /127.0.0.1:50549, bytes: 1777, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, duration: 4892000
2015-02-12 14:48:14,397 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,398 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52459, dest: /127.0.0.1:50539, bytes: 1777, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, duration: 7254000
2015-02-12 14:48:14,398 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,399 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,400 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52458, dest: /127.0.0.1:50543, bytes: 1777, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, duration: 8868000
2015-02-12 14:48:14,400 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,400 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,409 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,411 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:14,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,424 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:48:14,426 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190 src: /127.0.0.1:52462 dest: /127.0.0.1:50539
2015-02-12 14:48:14,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190 src: /127.0.0.1:52463 dest: /127.0.0.1:50543
2015-02-12 14:48:14,434 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190 src: /127.0.0.1:52464 dest: /127.0.0.1:50546
2015-02-12 14:48:14,437 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52464, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190, duration: 1481000
2015-02-12 14:48:14,437 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:14,438 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52463, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190, duration: 2474000
2015-02-12 14:48:14,439 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,439 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,440 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52462, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190, duration: 3609000
2015-02-12 14:48:14,440 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,441 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,443 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,444 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:14,445 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:48:14,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:14,454 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:48:14,456 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191 src: /127.0.0.1:52465 dest: /127.0.0.1:50543
2015-02-12 14:48:14,457 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191 src: /127.0.0.1:52466 dest: /127.0.0.1:50549
2015-02-12 14:48:14,459 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191 src: /127.0.0.1:52467 dest: /127.0.0.1:50546
2015-02-12 14:48:14,466 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52467, dest: /127.0.0.1:50546, bytes: 97069, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191, duration: 2591000
2015-02-12 14:48:14,466 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:14,467 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52466, dest: /127.0.0.1:50549, bytes: 97069, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191, duration: 2994000
2015-02-12 14:48:14,467 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,467 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,469 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52465, dest: /127.0.0.1:50543, bytes: 97069, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191, duration: 4481000
2015-02-12 14:48:14,470 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:14,470 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,474 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:14,476 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:14,476 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0017
2015-02-12 14:48:14,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017 dst=null perm=null proto=rpc
2015-02-12 14:48:14,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:14,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:14,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:14,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:14,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:14,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:14,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:14,508 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 17 submitted by user soberoi
2015-02-12 14:48:14,508 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0017
2015-02-12 14:48:14,509 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from NEW to NEW_SAVING
2015-02-12 14:48:14,509 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0017
2015-02-12 14:48:14,509 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0017
2015-02-12 14:48:14,509 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:48:14,509 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0017 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:48:14,510 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from SUBMITTED to ACCEPTED
2015-02-12 14:48:14,510 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0017_000001
2015-02-12 14:48:14,510 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from NEW to SUBMITTED
2015-02-12 14:48:14,510 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0017_000001 to scheduler from user: soberoi
2015-02-12 14:48:14,511 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:48:14,511 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0017
2015-02-12 14:48:14,516 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0017/
2015-02-12 14:48:14,516 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1423780884992_0017
2015-02-12 14:48:14,516 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0017/
2015-02-12 14:48:14,844 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:14,845 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:14,845 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000001
2015-02-12 14:48:14,845 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:48:14,846 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0017_01_000001
2015-02-12 14:48:14,846 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:14,846 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0017_000001
2015-02-12 14:48:14,846 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0017 AttemptId: appattempt_1423780884992_0017_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0017_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:48:14,846 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:48:14,847 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:48:14,847 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0017_000001
2015-02-12 14:48:14,848 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0017_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0017_000001
2015-02-12 14:48:14,848 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0017_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:48:14,848 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0017_000001
2015-02-12 14:48:14,848 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0017_000001
2015-02-12 14:48:14,850 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:14,852 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000001 by user soberoi
2015-02-12 14:48:14,853 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0017
2015-02-12 14:48:14,853 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000001
2015-02-12 14:48:14,853 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from NEW to INITING
2015-02-12 14:48:14,853 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000001 to application application_1423780884992_0017
2015-02-12 14:48:14,853 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from INITING to RUNNING
2015-02-12 14:48:14,853 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0017_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0017_000001
2015-02-12 14:48:14,854 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:48:14,854 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:48:14,854 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:14,854 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:14,854 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:48:14,854 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:48:14,855 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:14,855 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0017_01_000001
2015-02-12 14:48:14,865 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0017_01_000001.tokens. Credentials list:
2015-02-12 14:48:14,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:15,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0017_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000001.tokens
2015-02-12 14:48:15,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:15,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:15,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:15,233 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:15,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:15,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:15,317 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0017/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:15,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:15,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:15,403 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0017/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:15,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:15,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:15,503 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0017/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:15,503 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:15,557 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:15,557 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:15,692 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000001/default_container_executor.sh]
2015-02-12 14:48:15,847 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:15,847 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:15,940 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742012_1188 to datanode(s) 127.0.0.1:50539
2015-02-12 14:48:15,940 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742000_1176, blk_1073742002_1178, blk_1073742004_1180, blk_1073742005_1181, blk_1073741999_1175]
2015-02-12 14:48:15,940 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742000_1176, blk_1073742001_1177, blk_1073742002_1178, blk_1073742003_1179, blk_1073742004_1180, blk_1073742005_1181, blk_1073741999_1175]
2015-02-12 14:48:16,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000 for deletion
2015-02-12 14:48:16,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742001_1177 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742001 for deletion
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742002 for deletion
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742001_1177 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742001
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742003 for deletion
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742004_1180 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742004 for deletion
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742005_1181 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742005 for deletion
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999 for deletion
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742003
2015-02-12 14:48:16,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000
2015-02-12 14:48:16,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742005_1181 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742005
2015-02-12 14:48:16,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742002
2015-02-12 14:48:16,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999
2015-02-12 14:48:16,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742004_1180 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742004
2015-02-12 14:48:16,848 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:17,419 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 to 127.0.0.1:50539
2015-02-12 14:48:17,419 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000 for deletion
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742002 for deletion
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742004_1180 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742004 for deletion
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742005_1181 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742005 for deletion
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742004_1180 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742004
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999 for deletion
2015-02-12 14:48:17,420 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742002
2015-02-12 14:48:17,421 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:48:17,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 src: /127.0.0.1:52473 dest: /127.0.0.1:50539
2015-02-12 14:48:17,421 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742005_1181 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742005
2015-02-12 14:48:17,422 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999
2015-02-12 14:48:17,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188 src: /127.0.0.1:52473 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:48:17,423 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742012_1188 size 254067
2015-02-12 14:48:17,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:48:17,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:48:17,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:48:17,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:48:17,853 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:17,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017 dst=null perm=null proto=rpc
2015-02-12 14:48:17,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:48:17,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:48:18,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:18,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:18,645 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182
2015-02-12 14:48:18,646 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742005_1181
2015-02-12 14:48:18,647 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185
2015-02-12 14:48:18,647 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183
2015-02-12 14:48:18,856 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:18,945 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742000_1176, blk_1073742001_1177, blk_1073742002_1178, blk_1073742003_1179, blk_1073742005_1181, blk_1073741999_1175]
2015-02-12 14:48:18,945 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742000_1176, blk_1073742001_1177, blk_1073742003_1179, blk_1073742004_1180, blk_1073741999_1175]
2015-02-12 14:48:19,149 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:19,154 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0017_000001
2015-02-12 14:48:19,154 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0017 APPATTEMPTID=appattempt_1423780884992_0017_000001
2015-02-12 14:48:19,154 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:48:19,154 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from ACCEPTED to RUNNING
2015-02-12 14:48:19,162 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0016_01_000001 succeeded
2015-02-12 14:48:19,163 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:48:19,163 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0016_01_000001
2015-02-12 14:48:19,184 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000001
2015-02-12 14:48:19,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000001
2015-02-12 14:48:19,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000001
2015-02-12 14:48:19,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016/container_1423780884992_0016_01_000001
2015-02-12 14:48:19,185 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000001
2015-02-12 14:48:19,186 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0016_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:48:19,186 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0016_01_000001 from application application_1423780884992_0016
2015-02-12 14:48:19,186 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:19,186 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0016
2015-02-12 14:48:19,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:19,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:48:19,387 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182
2015-02-12 14:48:19,388 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186
2015-02-12 14:48:19,388 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184
2015-02-12 14:48:19,389 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187
2015-02-12 14:48:19,389 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183
2015-02-12 14:48:19,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:19,491 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184
2015-02-12 14:48:19,492 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742007_1183
2015-02-12 14:48:19,492 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187
2015-02-12 14:48:19,629 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188
2015-02-12 14:48:19,630 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185
2015-02-12 14:48:19,631 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742008_1184
2015-02-12 14:48:19,631 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186
2015-02-12 14:48:19,631 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189
2015-02-12 14:48:19,631 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742011_1187
2015-02-12 14:48:19,671 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:48:19,697 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188
2015-02-12 14:48:19,698 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191
2015-02-12 14:48:19,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742010_1186
2015-02-12 14:48:19,701 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189
2015-02-12 14:48:19,701 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742006_1182
2015-02-12 14:48:19,735 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192 src: /127.0.0.1:52481 dest: /127.0.0.1:50543
2015-02-12 14:48:19,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192 src: /127.0.0.1:52482 dest: /127.0.0.1:50549
2015-02-12 14:48:19,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192 src: /127.0.0.1:52483 dest: /127.0.0.1:50546
2015-02-12 14:48:19,795 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52483, dest: /127.0.0.1:50546, bytes: 113784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192, duration: 54618000
2015-02-12 14:48:19,796 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:19,796 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52482, dest: /127.0.0.1:50549, bytes: 113784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192, duration: 55426000
2015-02-12 14:48:19,797 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:19,797 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:19,798 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52481, dest: /127.0.0.1:50543, bytes: 113784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192, duration: 56941000
2015-02-12 14:48:19,798 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:19,800 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:19,800 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:19,805 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000 for deletion
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742001_1177 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742001 for deletion
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742002 for deletion
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742003 for deletion
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742005_1181 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742005 for deletion
2015-02-12 14:48:19,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999 for deletion
2015-02-12 14:48:19,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742002
2015-02-12 14:48:19,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742003
2015-02-12 14:48:19,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742001_1177 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742001
2015-02-12 14:48:19,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742005_1181 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742005
2015-02-12 14:48:19,812 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999
2015-02-12 14:48:19,857 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0016_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:19,857 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0016_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:48:19,857 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0016_000001
2015-02-12 14:48:19,858 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0016_000001
2015-02-12 14:48:19,858 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0016_000001 State change from FINISHING to FINISHED
2015-02-12 14:48:19,858 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000001
2015-02-12 14:48:19,858 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0016_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:48:19,858 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0016_000001 released container container_1423780884992_0016_01_000001 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:48:19,858 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:19,858 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0016 State change from FINISHING to FINISHED
2015-02-12 14:48:19,859 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0016
2015-02-12 14:48:19,859 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0016,name=[14481078A6E6441D98B6D1970BC11105/D5AE788ECD3C41C6B1748CC4496191D2] lhs/(1/1) ...edpipesplatform/samepipe3,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0016/jobhistory/job/job_1423780884992_0016,appMasterHost=10.1.1.67,startTime=1423781270212,finishTime=1423781293103,finalStatus=SUCCEEDED
2015-02-12 14:48:19,859 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0016_000001 is done. finalState=FINISHED
2015-02-12 14:48:19,859 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0016_000001
2015-02-12 14:48:19,859 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0016 requests cleared
2015-02-12 14:48:19,862 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0016_000001 (auth:SIMPLE)
2015-02-12 14:48:19,864 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0016_01_000001
2015-02-12 14:48:19,864 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0016 CONTAINERID=container_1423780884992_0016_01_000001
2015-02-12 14:48:19,866 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0016_01_000001]
2015-02-12 14:48:19,867 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:19,867 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:19,867 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:19,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:19,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:19,869 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0016
2015-02-12 14:48:19,869 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:19,869 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0016, with delay of 10800 seconds
2015-02-12 14:48:19,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:19,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:19,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:19,890 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:48:19,893 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742009_1185
2015-02-12 14:48:19,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193 src: /127.0.0.1:52485 dest: /127.0.0.1:50539
2015-02-12 14:48:19,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193 src: /127.0.0.1:52486 dest: /127.0.0.1:50546
2015-02-12 14:48:19,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193 src: /127.0.0.1:52487 dest: /127.0.0.1:50549
2015-02-12 14:48:19,918 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52487, dest: /127.0.0.1:50549, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193, duration: 11793000
2015-02-12 14:48:19,918 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:19,919 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:19,919 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52486, dest: /127.0.0.1:50546, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193, duration: 12582000
2015-02-12 14:48:19,919 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:19,920 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:19,920 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52485, dest: /127.0.0.1:50539, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193, duration: 13628000
2015-02-12 14:48:19,920 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:19,921 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:19,923 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017.summary is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:20,164 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:20,164 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,165 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0016
2015-02-12 14:48:20,166 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:20,166 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0016, with delay of 10800 seconds
2015-02-12 14:48:20,166 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,167 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,168 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000 for deletion
2015-02-12 14:48:20,168 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742001_1177 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742001 for deletion
2015-02-12 14:48:20,168 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742003 for deletion
2015-02-12 14:48:20,168 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742004_1180 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742004 for deletion
2015-02-12 14:48:20,168 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999 for deletion
2015-02-12 14:48:20,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,169 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742001_1177 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742001
2015-02-12 14:48:20,168 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742000
2015-02-12 14:48:20,169 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742004_1180 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742004
2015-02-12 14:48:20,170 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742003
2015-02-12 14:48:20,170 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741999
2015-02-12 14:48:20,209 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:20,210 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0016
2015-02-12 14:48:20,210 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:20,210 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:20,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,211 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0016
2015-02-12 14:48:20,211 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:20,211 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0016, with delay of 10800 seconds
2015-02-12 14:48:20,210 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0016, with delay of 10800 seconds
2015-02-12 14:48:20,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0016
2015-02-12 14:48:20,869 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:20,869 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:20,869 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000002
2015-02-12 14:48:20,870 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:48:21,164 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:21,165 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000003
2015-02-12 14:48:21,165 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:21,214 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:21,214 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000004
2015-02-12 14:48:21,214 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:21,215 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:21,215 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000005
2015-02-12 14:48:21,215 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:21,279 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0017_01_000002
2015-02-12 14:48:21,280 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:21,280 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0017_01_000003
2015-02-12 14:48:21,280 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:21,281 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0017_01_000004
2015-02-12 14:48:21,281 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:21,282 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0017_01_000005
2015-02-12 14:48:21,282 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:21,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:21,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:21,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:21,438 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:21,438 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:21,438 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:21,439 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:21,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000002 by user soberoi
2015-02-12 14:48:21,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000005 by user soberoi
2015-02-12 14:48:21,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000004 by user soberoi
2015-02-12 14:48:21,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0017
2015-02-12 14:48:21,443 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000002 to application application_1423780884992_0017
2015-02-12 14:48:21,443 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000005
2015-02-12 14:48:21,443 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:48:21,443 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,443 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,443 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:21,443 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0017
2015-02-12 14:48:21,444 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:21,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000003 by user soberoi
2015-02-12 14:48:21,444 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0017
2015-02-12 14:48:21,444 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000003
2015-02-12 14:48:21,443 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from NEW to INITING
2015-02-12 14:48:21,445 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000005 to application application_1423780884992_0017
2015-02-12 14:48:21,445 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from INITING to RUNNING
2015-02-12 14:48:21,445 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:48:21,445 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from NEW to INITING
2015-02-12 14:48:21,446 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000003 to application application_1423780884992_0017
2015-02-12 14:48:21,446 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from INITING to RUNNING
2015-02-12 14:48:21,446 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:48:21,446 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,446 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,446 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:21,446 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0017
2015-02-12 14:48:21,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0017
2015-02-12 14:48:21,447 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:21,447 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:21,447 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0017_01_000003
2015-02-12 14:48:21,447 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000004
2015-02-12 14:48:21,442 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000002
2015-02-12 14:48:21,449 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from NEW to INITING
2015-02-12 14:48:21,449 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000004 to application application_1423780884992_0017
2015-02-12 14:48:21,449 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from INITING to RUNNING
2015-02-12 14:48:21,449 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:48:21,450 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,450 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,450 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:21,450 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0017
2015-02-12 14:48:21,450 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:21,450 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:21,450 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0017_01_000004
2015-02-12 14:48:21,445 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,452 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0017
2015-02-12 14:48:21,452 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:21,452 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0017
2015-02-12 14:48:21,452 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:21,452 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:21,452 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0017_01_000005
2015-02-12 14:48:21,474 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0017_01_000005.tokens. Credentials list:
2015-02-12 14:48:21,475 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0017_01_000004.tokens. Credentials list:
2015-02-12 14:48:21,475 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0017_01_000003.tokens. Credentials list:
2015-02-12 14:48:21,516 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:21,517 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:21,692 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:21,697 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:21,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:21,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000002/default_container_executor.sh]
2015-02-12 14:48:21,872 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:21,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:21,873 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000006
2015-02-12 14:48:21,873 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:48:21,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0017_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000003.tokens
2015-02-12 14:48:21,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:21,912 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0017_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000005.tokens
2015-02-12 14:48:21,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:21,912 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0017_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000004.tokens
2015-02-12 14:48:21,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:22,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:22,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:22,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:22,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:22,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:22,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:22,105 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:22,120 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0017/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:22,127 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0017/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:22,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:22,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:22,168 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:22,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:22,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:22,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:22,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:22,217 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:22,217 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:22,221 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0017/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:22,221 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:22,231 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0017/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:22,231 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:22,238 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0017/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:22,238 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:22,296 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:22,296 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:22,297 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:22,297 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:22,297 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:22,297 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:22,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:22,322 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:22,325 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000006 by user soberoi
2015-02-12 14:48:22,325 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000006
2015-02-12 14:48:22,326 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000006 to application application_1423780884992_0017
2015-02-12 14:48:22,326 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:48:22,326 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:22,326 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0017
2015-02-12 14:48:22,326 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:22,326 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0017
2015-02-12 14:48:22,327 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:22,397 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:22,397 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:22,549 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000003/default_container_executor.sh]
2015-02-12 14:48:22,560 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000005/default_container_executor.sh]
2015-02-12 14:48:22,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000004/default_container_executor.sh]
2015-02-12 14:48:22,685 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000006/default_container_executor.sh]
2015-02-12 14:48:22,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:22,873 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0017
2015-02-12 14:48:22,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:48:22,874 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0017_01_000007 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@711f1c41
2015-02-12 14:48:23,170 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:23,171 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000008
2015-02-12 14:48:23,171 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:48:23,305 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:48:23,305 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:23,651 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191
2015-02-12 14:48:23,651 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189
2015-02-12 14:48:23,652 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190
2015-02-12 14:48:23,853 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188
2015-02-12 14:48:23,875 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0017_000001 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096
2015-02-12 14:48:23,875 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0017 unreserved on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:48:24,309 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:48:24,309 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:48:24,309 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000008
2015-02-12 14:48:24,310 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:48:24,310 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000008 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:48:24,394 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742012_1188
2015-02-12 14:48:24,396 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190
2015-02-12 14:48:24,397 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742013_1189
2015-02-12 14:48:24,640 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742014_1190
2015-02-12 14:48:24,641 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742015_1191
2015-02-12 14:48:24,901 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192
2015-02-12 14:48:25,176 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0017_01_000008
2015-02-12 14:48:28,857 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192
2015-02-12 14:48:29,401 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193
2015-02-12 14:48:29,648 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742016_1192
2015-02-12 14:48:29,648 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193
2015-02-12 14:48:29,907 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742017_1193
2015-02-12 14:48:31,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:31,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:32,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:32,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:32,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:32,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:32,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:32,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:32,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:32,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt dst=null perm=null proto=rpc
2015-02-12 14:48:32,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:32,905 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:32,906 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000002
2015-02-12 14:48:32,907 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000002
2015-02-12 14:48:32,907 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:48:32,907 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000002
2015-02-12 14:48:32,929 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0017_01_000002 is : 143
2015-02-12 14:48:32,929 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:48:32,929 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 1538 Total time for transactions(ms): 141 Number of transactions batched in Syncs: 7 Number of syncs: 1054 SyncTimes(ms): 356 250
2015-02-12 14:48:32,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194 src: /127.0.0.1:52547 dest: /127.0.0.1:50539
2015-02-12 14:48:32,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194 src: /127.0.0.1:52548 dest: /127.0.0.1:50549
2015-02-12 14:48:32,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194 src: /127.0.0.1:52549 dest: /127.0.0.1:50546
2015-02-12 14:48:32,951 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:32,954 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000002
2015-02-12 14:48:32,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000002
2015-02-12 14:48:32,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000002
2015-02-12 14:48:32,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000002
2015-02-12 14:48:32,956 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000002
2015-02-12 14:48:32,958 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:32,959 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000002 from application application_1423780884992_0017
2015-02-12 14:48:32,959 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist for DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:32,959 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:32,959 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:33,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:48:33,066 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:33,068 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000003
2015-02-12 14:48:33,068 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000003
2015-02-12 14:48:33,068 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:48:33,069 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000003
2015-02-12 14:48:33,091 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0017_01_000003 is : 143
2015-02-12 14:48:33,102 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:33,102 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000003
2015-02-12 14:48:33,103 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000003
2015-02-12 14:48:33,103 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000003
2015-02-12 14:48:33,103 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000003
2015-02-12 14:48:33,103 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000003
2015-02-12 14:48:33,104 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:33,104 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000003 from application application_1423780884992_0017
2015-02-12 14:48:33,105 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:33,105 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:33,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:48:33,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:48:33,187 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:33,190 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000004
2015-02-12 14:48:33,190 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000004
2015-02-12 14:48:33,191 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:48:33,191 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000004
2015-02-12 14:48:33,211 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0017_01_000004 is : 143
2015-02-12 14:48:33,219 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:33,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000004
2015-02-12 14:48:33,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000004
2015-02-12 14:48:33,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000004
2015-02-12 14:48:33,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000004
2015-02-12 14:48:33,221 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000004
2015-02-12 14:48:33,221 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:33,221 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000004 from application application_1423780884992_0017
2015-02-12 14:48:33,221 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:33,221 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:33,235 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:33,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:48:33,238 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000006
2015-02-12 14:48:33,238 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000006
2015-02-12 14:48:33,238 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:48:33,239 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000006
2015-02-12 14:48:33,240 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:33,240 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:48:33,240 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000002
2015-02-12 14:48:33,240 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:48:33,240 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000002 on node: host: 10.1.1.67:50571 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:48:33,261 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0017_01_000006 is : 143
2015-02-12 14:48:33,275 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:33,277 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000005
2015-02-12 14:48:33,277 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000005
2015-02-12 14:48:33,277 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:48:33,277 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000005
2015-02-12 14:48:33,282 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:33,283 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000006
2015-02-12 14:48:33,285 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000006
2015-02-12 14:48:33,289 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000006
2015-02-12 14:48:33,290 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000006
2015-02-12 14:48:33,291 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000006
2015-02-12 14:48:33,291 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:33,292 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000006 from application application_1423780884992_0017
2015-02-12 14:48:33,293 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:33,294 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:33,302 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0017_01_000005 is : 143
2015-02-12 14:48:33,315 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:33,317 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000005
2015-02-12 14:48:33,317 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:33,317 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000005 from application application_1423780884992_0017
2015-02-12 14:48:33,317 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:33,317 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:33,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000005
2015-02-12 14:48:33,319 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000005
2015-02-12 14:48:33,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000005
2015-02-12 14:48:33,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000005
2015-02-12 14:48:34,073 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:34,073 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:48:34,073 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000003
2015-02-12 14:48:34,073 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:34,073 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:34,194 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:34,194 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:48:34,194 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000004
2015-02-12 14:48:34,194 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:34,194 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:34,240 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:34,240 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:34,240 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:48:34,240 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000006
2015-02-12 14:48:34,240 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:48:34,240 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:48:34,283 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:34,283 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:48:34,283 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000005
2015-02-12 14:48:34,284 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:34,284 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000005 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:35,077 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:35,078 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:35,078 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000009
2015-02-12 14:48:35,078 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0017_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:35,194 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:35,240 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0017_01_000002]
2015-02-12 14:48:35,241 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:35,241 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:35,284 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:35,369 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:35,383 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:35,385 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0017_01_000009 by user soberoi
2015-02-12 14:48:35,385 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000009
2015-02-12 14:48:35,385 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0017_01_000009 to application application_1423780884992_0017
2015-02-12 14:48:35,386 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:48:35,386 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0017
2015-02-12 14:48:35,386 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0017
2015-02-12 14:48:35,386 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:35,386 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0017
2015-02-12 14:48:35,387 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:35,416 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:35,416 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:35,539 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000009/default_container_executor.sh]
2015-02-12 14:48:36,081 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0017_01_000003]
2015-02-12 14:48:36,082 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:36,082 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:36,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0017_01_000004]
2015-02-12 14:48:36,199 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:36,245 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0017_01_000006]
2015-02-12 14:48:36,245 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:36,287 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0017_01_000005]
2015-02-12 14:48:36,288 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:36,375 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:48:38,189 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:38,198 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:38,200 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:38,212 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:38,221 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:48:38,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,521 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:48:38,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195 src: /127.0.0.1:52564 dest: /127.0.0.1:50539
2015-02-12 14:48:38,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195 src: /127.0.0.1:52565 dest: /127.0.0.1:50543
2015-02-12 14:48:38,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195 src: /127.0.0.1:52566 dest: /127.0.0.1:50546
2015-02-12 14:48:38,664 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52566, dest: /127.0.0.1:50546, bytes: 296, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0017_r_000000_0_-847060260_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195, duration: 37258000
2015-02-12 14:48:38,665 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:38,665 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,665 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52565, dest: /127.0.0.1:50543, bytes: 296, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0017_r_000000_0_-847060260_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195, duration: 38114000
2015-02-12 14:48:38,666 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,666 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,666 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52564, dest: /127.0.0.1:50539, bytes: 296, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0017_r_000000_0_-847060260_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195, duration: 39080000
2015-02-12 14:48:38,666 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,667 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,684 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0017_r_000000_0_-847060260_1
2015-02-12 14:48:38,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:38,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:38,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/task_1423780884992_0017_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:48:38,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1423780884992_0017_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/task_1423780884992_0017_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:48:38,736 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:38,739 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000009
2015-02-12 14:48:38,739 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000009
2015-02-12 14:48:38,743 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:48:38,743 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000009
2015-02-12 14:48:38,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,760 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:48:38,780 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0017_01_000009 is : 143
2015-02-12 14:48:38,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:38,783 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:38,784 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000009
2015-02-12 14:48:38,784 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:38,784 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000009 from application application_1423780884992_0017
2015-02-12 14:48:38,784 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:38,784 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:38,787 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000009
2015-02-12 14:48:38,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000009
2015-02-12 14:48:38,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000009
2015-02-12 14:48:38,790 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000009
2015-02-12 14:48:38,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:38,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/task_1423780884992_0017_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:48:38,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:38,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary/1/task_1423780884992_0017_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary dst=null perm=null proto=rpc
2015-02-12 14:48:38,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,816 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,822 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,840 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52549, dest: /127.0.0.1:50546, bytes: 69166, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194, duration: 5893761000
2015-02-12 14:48:38,840 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:38,841 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16364
2015-02-12 14:48:38,841 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52548, dest: /127.0.0.1:50549, bytes: 69166, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194, duration: 5895136000
2015-02-12 14:48:38,841 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,844 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16364
2015-02-12 14:48:38,844 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52547, dest: /127.0.0.1:50539, bytes: 69166, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194, duration: 5894238000
2015-02-12 14:48:38,844 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16364
2015-02-12 14:48:38,848 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,853 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:48:38,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196 src: /127.0.0.1:52568 dest: /127.0.0.1:50546
2015-02-12 14:48:38,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196 src: /127.0.0.1:52569 dest: /127.0.0.1:50543
2015-02-12 14:48:38,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196 src: /127.0.0.1:52570 dest: /127.0.0.1:50539
2015-02-12 14:48:38,863 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52570, dest: /127.0.0.1:50539, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196, duration: 1500000
2015-02-12 14:48:38,864 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:38,864 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,864 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52569, dest: /127.0.0.1:50543, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196, duration: 2422000
2015-02-12 14:48:38,865 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,865 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,865 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52568, dest: /127.0.0.1:50546, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196, duration: 3310000
2015-02-12 14:48:38,866 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,869 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,873 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary_tmp is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:38,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:48:38,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:38,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:48:38,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:38,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:48:38,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,902 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:48:38,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197 src: /127.0.0.1:52572 dest: /127.0.0.1:50549
2015-02-12 14:48:38,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197 src: /127.0.0.1:52573 dest: /127.0.0.1:50539
2015-02-12 14:48:38,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197 src: /127.0.0.1:52574 dest: /127.0.0.1:50543
2015-02-12 14:48:38,913 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52574, dest: /127.0.0.1:50543, bytes: 69166, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197, duration: 2781000
2015-02-12 14:48:38,913 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:38,913 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,914 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52573, dest: /127.0.0.1:50539, bytes: 69166, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197, duration: 2716000
2015-02-12 14:48:38,914 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,914 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,914 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52572, dest: /127.0.0.1:50549, bytes: 69166, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197, duration: 3491000
2015-02-12 14:48:38,915 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,915 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,918 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:38,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:48:38,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:38,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:48:38,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:48:38,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017/job_1423780884992_0017_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:48:38,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:38,942 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:48:38,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198 src: /127.0.0.1:52576 dest: /127.0.0.1:50546
2015-02-12 14:48:38,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198 src: /127.0.0.1:52577 dest: /127.0.0.1:50543
2015-02-12 14:48:38,947 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198 src: /127.0.0.1:52578 dest: /127.0.0.1:50539
2015-02-12 14:48:38,955 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52578, dest: /127.0.0.1:50539, bytes: 113784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198, duration: 5312000
2015-02-12 14:48:38,955 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:38,956 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:48:38,956 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52577, dest: /127.0.0.1:50543, bytes: 113784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198, duration: 6241000
2015-02-12 14:48:38,956 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,957 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52576, dest: /127.0.0.1:50546, bytes: 113784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-879322258_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198, duration: 7711000
2015-02-12 14:48:38,957 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,958 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:38,958 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:38,961 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-879322258_1
2015-02-12 14:48:38,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:38,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:38,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:38,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:48:38,985 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0017_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:48:38,985 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:48:38,985 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0017 with final state: FINISHING
2015-02-12 14:48:38,985 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from RUNNING to FINAL_SAVING
2015-02-12 14:48:38,986 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0017
2015-02-12 14:48:38,986 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:48:38,986 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from FINAL_SAVING to FINISHING
2015-02-12 14:48:39,566 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30001 milliseconds
2015-02-12 14:48:39,567 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:48:39,750 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:39,750 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:48:39,750 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000009
2015-02-12 14:48:39,750 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:39,750 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000009 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:39,994 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0017 unregistered successfully.
2015-02-12 14:48:39,998 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742012_1188 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:48:39,998 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742013_1189 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:48:39,998 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742014_1190 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:48:39,998 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742015_1191 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:48:39,998 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742017_1193 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:48:39,998 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742018_1194 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:48:39,999 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742016_1192 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:48:39,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0017 dst=null perm=null proto=rpc
2015-02-12 14:48:40,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,044 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary
2015-02-12 14:48:40,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/_temporary dst=null perm=null proto=rpc
2015-02-12 14:48:40,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,064 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:40,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:40,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,085 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:40,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:40,089 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cross
2015-02-12 14:48:40,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross dst=null perm=null proto=rpc
2015-02-12 14:48:40,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:40,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cross/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:48:40,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:40,106 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:48:40,107 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:48:40,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:48:40,119 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] starting
2015-02-12 14:48:40,119 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:48:40,119 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe"]
2015-02-12 14:48:40,119 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] parallel execution is enabled: true
2015-02-12 14:48:40,120 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] starting jobs: 1
2015-02-12 14:48:40,120 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] allocating threads: 1
2015-02-12 14:48:40,122 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] starting step: (1/1) ...dedpipesplatform/samepipe
2015-02-12 14:48:40,137 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:48:40,148 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:48:40,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:48:40,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:48:40,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:48:40,154 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 18
2015-02-12 14:48:40,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018 dst=null perm=null proto=rpc
2015-02-12 14:48:40,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:48:40,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:48:40,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,163 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:48:40,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 src: /127.0.0.1:52583 dest: /127.0.0.1:50543
2015-02-12 14:48:40,167 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 src: /127.0.0.1:52584 dest: /127.0.0.1:50539
2015-02-12 14:48:40,169 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 src: /127.0.0.1:52585 dest: /127.0.0.1:50549
2015-02-12 14:48:40,178 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52585, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199, duration: 2251000
2015-02-12 14:48:40,178 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:40,181 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:40,181 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52584, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199, duration: 4207000
2015-02-12 14:48:40,181 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,182 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:40,182 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52583, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199, duration: 6820000
2015-02-12 14:48:40,182 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,184 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:40,185 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:40,186 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar
2015-02-12 14:48:40,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:48:40,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:48:40,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:48:40,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:48:40,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:48:40,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:40,210 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:48:40,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:40,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,217 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split
2015-02-12 14:48:40,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:40,219 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:48:40,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200 src: /127.0.0.1:52586 dest: /127.0.0.1:50539
2015-02-12 14:48:40,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200 src: /127.0.0.1:52587 dest: /127.0.0.1:50543
2015-02-12 14:48:40,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200 src: /127.0.0.1:52588 dest: /127.0.0.1:50549
2015-02-12 14:48:40,230 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200 src: /127.0.0.1:52589 dest: /127.0.0.1:50546
2015-02-12 14:48:40,234 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52589, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, duration: 1863000
2015-02-12 14:48:40,234 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:40,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:48:40,235 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52588, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, duration: 2695000
2015-02-12 14:48:40,235 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:40,237 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52587, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, duration: 3859000
2015-02-12 14:48:40,238 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,239 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52586, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, duration: 7080000
2015-02-12 14:48:40,240 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:40,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:40,242 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:40,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,247 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:48:40,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201 src: /127.0.0.1:52590 dest: /127.0.0.1:50546
2015-02-12 14:48:40,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201 src: /127.0.0.1:52591 dest: /127.0.0.1:50539
2015-02-12 14:48:40,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201 src: /127.0.0.1:52592 dest: /127.0.0.1:50543
2015-02-12 14:48:40,255 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52592, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201, duration: 1210000
2015-02-12 14:48:40,256 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:40,256 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52591, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201, duration: 2150000
2015-02-12 14:48:40,257 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:48:40,258 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52590, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201, duration: 3696000
2015-02-12 14:48:40,258 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,260 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:48:40,260 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:48:40,261 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:40,262 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:48:40,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:48:40,274 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:48:40,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202 src: /127.0.0.1:52593 dest: /127.0.0.1:50549
2015-02-12 14:48:40,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202 src: /127.0.0.1:52594 dest: /127.0.0.1:50546
2015-02-12 14:48:40,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202 src: /127.0.0.1:52595 dest: /127.0.0.1:50543
2015-02-12 14:48:40,287 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52595, dest: /127.0.0.1:50543, bytes: 96672, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202, duration: 1939000
2015-02-12 14:48:40,289 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:40,290 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52594, dest: /127.0.0.1:50546, bytes: 96672, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202, duration: 4307000
2015-02-12 14:48:40,290 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:48:40,290 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,291 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:48:40,291 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52593, dest: /127.0.0.1:50549, bytes: 96672, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202, duration: 5865000
2015-02-12 14:48:40,291 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:40,294 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742026_1202 size 96672
2015-02-12 14:48:40,294 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:48:40,294 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0018
2015-02-12 14:48:40,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018 dst=null perm=null proto=rpc
2015-02-12 14:48:40,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:40,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:40,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:40,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:40,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:40,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:40,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:40,313 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 18 submitted by user soberoi
2015-02-12 14:48:40,313 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0018
2015-02-12 14:48:40,313 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from NEW to NEW_SAVING
2015-02-12 14:48:40,313 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0018
2015-02-12 14:48:40,314 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0018
2015-02-12 14:48:40,314 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:48:40,314 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0018 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:48:40,315 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from SUBMITTED to ACCEPTED
2015-02-12 14:48:40,315 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0018_000001
2015-02-12 14:48:40,315 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from NEW to SUBMITTED
2015-02-12 14:48:40,315 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0018_000001 to scheduler from user: soberoi
2015-02-12 14:48:40,316 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:48:40,316 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0018
2015-02-12 14:48:40,318 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0018/
2015-02-12 14:48:40,319 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] submitted hadoop job: job_1423780884992_0018
2015-02-12 14:48:40,319 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0018/
2015-02-12 14:48:40,750 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:40,751 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:40,751 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000001
2015-02-12 14:48:40,752 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:48:40,752 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0018_01_000001
2015-02-12 14:48:40,752 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:40,753 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0018_000001
2015-02-12 14:48:40,753 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0018 AttemptId: appattempt_1423780884992_0018_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0018_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:48:40,753 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:48:40,753 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:48:40,753 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0018_000001
2015-02-12 14:48:40,754 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0018_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0018_000001
2015-02-12 14:48:40,754 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0018_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:48:40,755 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0018_000001
2015-02-12 14:48:40,755 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0018_000001
2015-02-12 14:48:40,757 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:40,759 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000001 by user soberoi
2015-02-12 14:48:40,759 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0018
2015-02-12 14:48:40,759 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000001
2015-02-12 14:48:40,759 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from NEW to INITING
2015-02-12 14:48:40,760 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000001 to application application_1423780884992_0018
2015-02-12 14:48:40,760 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from INITING to RUNNING
2015-02-12 14:48:40,760 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:48:40,760 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0018_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0018_000001
2015-02-12 14:48:40,760 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:40,760 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:48:40,761 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:40,761 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:48:40,761 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:48:40,761 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:40,761 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0018_01_000001
2015-02-12 14:48:40,771 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0018_01_000001.tokens. Credentials list:
2015-02-12 14:48:40,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:40,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0018_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000001.tokens
2015-02-12 14:48:40,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:48:41,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:41,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:41,116 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0018/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:41,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:41,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:41,176 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0018/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:41,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:41,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:41,234 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:41,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:41,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:41,304 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0018/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:41,304 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:41,341 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:41,341 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:41,465 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000001/default_container_executor.sh]
2015-02-12 14:48:41,750 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:41,751 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:42,755 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:42,973 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742023_1199 to datanode(s) 127.0.0.1:50546
2015-02-12 14:48:42,973 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742016_1192, blk_1073742012_1188, blk_1073742013_1189, blk_1073742014_1190, blk_1073742015_1191]
2015-02-12 14:48:42,973 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742017_1193, blk_1073742018_1194, blk_1073742012_1188, blk_1073742013_1189, blk_1073742014_1190]
2015-02-12 14:48:43,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:48:43,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:48:43,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:48:43,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:48:43,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018 dst=null perm=null proto=rpc
2015-02-12 14:48:43,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:48:43,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:48:43,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:43,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:48:43,759 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:43,826 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742017_1193 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742017 for deletion
2015-02-12 14:48:43,826 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742018_1194 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742018 for deletion
2015-02-12 14:48:43,826 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012 for deletion
2015-02-12 14:48:43,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742017_1193 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742017
2015-02-12 14:48:43,826 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742016 for deletion
2015-02-12 14:48:43,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012 for deletion
2015-02-12 14:48:43,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013 for deletion
2015-02-12 14:48:43,828 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013 for deletion
2015-02-12 14:48:43,828 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742014_1190 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742014 for deletion
2015-02-12 14:48:43,828 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742014_1190 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742014 for deletion
2015-02-12 14:48:43,828 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742016
2015-02-12 14:48:43,829 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013
2015-02-12 14:48:43,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742018_1194 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742018
2015-02-12 14:48:43,829 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742014_1190 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742014
2015-02-12 14:48:43,829 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012
2015-02-12 14:48:43,829 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012
2015-02-12 14:48:43,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742014_1190 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742014
2015-02-12 14:48:43,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013
2015-02-12 14:48:43,828 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742015_1191 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742015 for deletion
2015-02-12 14:48:43,832 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742015_1191 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742015
2015-02-12 14:48:43,873 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195
2015-02-12 14:48:43,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196
2015-02-12 14:48:44,417 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197
2015-02-12 14:48:44,418 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196
2015-02-12 14:48:44,418 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195
2015-02-12 14:48:44,419 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198
2015-02-12 14:48:44,442 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 to 127.0.0.1:50546
2015-02-12 14:48:44,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 src: /127.0.0.1:52605 dest: /127.0.0.1:50546
2015-02-12 14:48:44,443 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:48:44,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199 src: /127.0.0.1:52605 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:48:44,445 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742023_1199 size 254067
2015-02-12 14:48:44,652 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:44,653 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0018_000001
2015-02-12 14:48:44,654 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0018 APPATTEMPTID=appattempt_1423780884992_0018_000001
2015-02-12 14:48:44,654 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:48:44,654 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from ACCEPTED to RUNNING
2015-02-12 14:48:44,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742019_1195
2015-02-12 14:48:44,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194
2015-02-12 14:48:44,665 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198
2015-02-12 14:48:44,665 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742020_1196
2015-02-12 14:48:44,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:44,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:48:44,763 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:44,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:44,919 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742018_1194
2015-02-12 14:48:44,920 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197
2015-02-12 14:48:45,041 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0017_01_000001 succeeded
2015-02-12 14:48:45,041 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:48:45,041 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0017_01_000001
2015-02-12 14:48:45,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000001
2015-02-12 14:48:45,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000001
2015-02-12 14:48:45,063 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000001
2015-02-12 14:48:45,063 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017/container_1423780884992_0017_01_000001
2015-02-12 14:48:45,063 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000001
2015-02-12 14:48:45,063 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0017_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:48:45,064 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0017_01_000001 from application application_1423780884992_0017
2015-02-12 14:48:45,064 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:45,064 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0017
2015-02-12 14:48:45,113 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:48:45,170 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203 src: /127.0.0.1:52609 dest: /127.0.0.1:50543
2015-02-12 14:48:45,171 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203 src: /127.0.0.1:52610 dest: /127.0.0.1:50549
2015-02-12 14:48:45,173 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203 src: /127.0.0.1:52611 dest: /127.0.0.1:50539
2015-02-12 14:48:45,215 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52611, dest: /127.0.0.1:50539, bytes: 113387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203, duration: 41117000
2015-02-12 14:48:45,216 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:45,216 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52610, dest: /127.0.0.1:50549, bytes: 113387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203, duration: 41937000
2015-02-12 14:48:45,216 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:45,217 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52609, dest: /127.0.0.1:50543, bytes: 113387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203, duration: 42872000
2015-02-12 14:48:45,217 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:45,217 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:45,219 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:45,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:45,226 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:48:45,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:48:45,262 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:48:45,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204 src: /127.0.0.1:52612 dest: /127.0.0.1:50546
2015-02-12 14:48:45,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204 src: /127.0.0.1:52613 dest: /127.0.0.1:50549
2015-02-12 14:48:45,269 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0017_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:45,269 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0017_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:48:45,269 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000001
2015-02-12 14:48:45,269 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204 src: /127.0.0.1:52614 dest: /127.0.0.1:50539
2015-02-12 14:48:45,269 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0017_000001
2015-02-12 14:48:45,269 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0017_000001
2015-02-12 14:48:45,269 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0017_000001 State change from FINISHING to FINISHED
2015-02-12 14:48:45,269 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0017 State change from FINISHING to FINISHED
2015-02-12 14:48:45,269 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0017_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:45,270 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0017
2015-02-12 14:48:45,270 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0017_000001 released container container_1423780884992_0017_01_000001 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:45,270 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0017_000001 is done. finalState=FINISHED
2015-02-12 14:48:45,270 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0017 requests cleared
2015-02-12 14:48:45,270 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0017_000001
2015-02-12 14:48:45,270 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0017,name=[060CF11AF99843BA87D87F2D7C396060/52322782CE9946C9B3CBFAB8E5295A1A] lhs*rhs/(1/1) ...ieldedpipesplatform/cross,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0017/jobhistory/job/job_1423780884992_0017,appMasterHost=10.1.1.67,startTime=1423781294508,finishTime=1423781318985,finalStatus=SUCCEEDED
2015-02-12 14:48:45,273 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0017_000001 (auth:SIMPLE)
2015-02-12 14:48:45,275 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0017_01_000001
2015-02-12 14:48:45,275 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0017 CONTAINERID=container_1423780884992_0017_01_000001
2015-02-12 14:48:45,275 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0017_01_000001]
2015-02-12 14:48:45,276 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:45,276 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:45,276 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,279 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0017
2015-02-12 14:48:45,279 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,279 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,280 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:45,281 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0017, with delay of 10800 seconds
2015-02-12 14:48:45,283 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52614, dest: /127.0.0.1:50539, bytes: 389, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204, duration: 11924000
2015-02-12 14:48:45,283 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:48:45,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:45,284 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52613, dest: /127.0.0.1:50549, bytes: 389, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204, duration: 12411000
2015-02-12 14:48:45,284 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:45,285 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52612, dest: /127.0.0.1:50546, bytes: 389, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204, duration: 14238000
2015-02-12 14:48:45,286 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:48:45,285 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:45,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:48:45,292 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018.summary is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:48:45,304 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:45,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,305 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0017
2015-02-12 14:48:45,305 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:45,305 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0017, with delay of 10800 seconds
2015-02-12 14:48:45,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,767 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:45,767 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:45,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:45,767 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000002
2015-02-12 14:48:45,768 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:48:45,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,767 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:45,768 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0017
2015-02-12 14:48:45,769 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:45,770 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0017, with delay of 10800 seconds
2015-02-12 14:48:45,976 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742016_1192, blk_1073742017_1193, blk_1073742018_1194, blk_1073742012_1188, blk_1073742013_1189, blk_1073742015_1191]
2015-02-12 14:48:45,976 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742016_1192, blk_1073742017_1193, blk_1073742018_1194, blk_1073742012_1188, blk_1073742013_1189, blk_1073742014_1190, blk_1073742015_1191]
2015-02-12 14:48:46,217 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:48:46,217 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:46,217 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000003
2015-02-12 14:48:46,217 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:46,218 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:46,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:46,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:46,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0017
2015-02-12 14:48:46,219 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0017
2015-02-12 14:48:46,220 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:48:46,220 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0017, with delay of 10800 seconds
2015-02-12 14:48:46,281 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:46,281 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000004
2015-02-12 14:48:46,281 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:46,307 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:46,308 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000005
2015-02-12 14:48:46,308 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:46,706 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0018_01_000002
2015-02-12 14:48:46,706 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:46,706 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0018_01_000003
2015-02-12 14:48:46,707 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:46,707 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0018_01_000004
2015-02-12 14:48:46,707 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:46,708 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0018_01_000005
2015-02-12 14:48:46,708 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:46,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:46,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:46,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,770 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:46,770 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:46,770 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000006
2015-02-12 14:48:46,770 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:48:46,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:48:46,854 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:46,854 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:46,854 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:46,854 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:46,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000002 by user soberoi
2015-02-12 14:48:46,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000005 by user soberoi
2015-02-12 14:48:46,857 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000002
2015-02-12 14:48:46,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0018
2015-02-12 14:48:46,858 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000005
2015-02-12 14:48:46,858 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from NEW to INITING
2015-02-12 14:48:46,858 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000005 to application application_1423780884992_0018
2015-02-12 14:48:46,858 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from INITING to RUNNING
2015-02-12 14:48:46,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000003 by user soberoi
2015-02-12 14:48:46,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000004 by user soberoi
2015-02-12 14:48:46,859 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0018
2015-02-12 14:48:46,859 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0018
2015-02-12 14:48:46,859 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000003
2015-02-12 14:48:46,859 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from NEW to INITING
2015-02-12 14:48:46,859 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000004 to application application_1423780884992_0018
2015-02-12 14:48:46,858 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:48:46,860 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,860 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,860 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:46,860 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0018
2015-02-12 14:48:46,860 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:46,860 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:46,857 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000002 to application application_1423780884992_0018
2015-02-12 14:48:46,861 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:48:46,861 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,861 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,861 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:46,860 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0018_01_000005
2015-02-12 14:48:46,861 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0018
2015-02-12 14:48:46,859 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from INITING to RUNNING
2015-02-12 14:48:46,862 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:46,862 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:48:46,862 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,862 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,862 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:46,862 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0018
2015-02-12 14:48:46,862 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:46,862 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:46,863 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0018_01_000004
2015-02-12 14:48:46,859 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from NEW to INITING
2015-02-12 14:48:46,863 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000003 to application application_1423780884992_0018
2015-02-12 14:48:46,863 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from INITING to RUNNING
2015-02-12 14:48:46,864 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:48:46,864 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,864 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0018
2015-02-12 14:48:46,864 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:46,864 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0018
2015-02-12 14:48:46,864 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:48:46,864 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:48:46,864 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0018_01_000003
2015-02-12 14:48:46,859 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000004
2015-02-12 14:48:46,886 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0018_01_000004.tokens. Credentials list:
2015-02-12 14:48:46,886 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0018_01_000003.tokens. Credentials list:
2015-02-12 14:48:46,888 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0018_01_000005.tokens. Credentials list:
2015-02-12 14:48:46,948 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:46,948 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:47,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:47,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:47,118 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:48:47,186 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742016 for deletion
2015-02-12 14:48:47,186 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742017_1193 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742017 for deletion
2015-02-12 14:48:47,187 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742018_1194 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742018 for deletion
2015-02-12 14:48:47,187 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012 for deletion
2015-02-12 14:48:47,187 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013 for deletion
2015-02-12 14:48:47,187 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742014_1190 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742014 for deletion
2015-02-12 14:48:47,187 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742015_1191 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742015 for deletion
2015-02-12 14:48:47,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742016
2015-02-12 14:48:47,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742018_1194 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742018
2015-02-12 14:48:47,190 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012
2015-02-12 14:48:47,190 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742014_1190 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742014
2015-02-12 14:48:47,190 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742017_1193 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742017
2015-02-12 14:48:47,191 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013
2015-02-12 14:48:47,191 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742015_1191 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742015
2015-02-12 14:48:47,207 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000002/default_container_executor.sh]
2015-02-12 14:48:47,218 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:47,283 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:47,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0018_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000003.tokens
2015-02-12 14:48:47,309 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:48:47,310 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:47,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0018_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000005.tokens
2015-02-12 14:48:47,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:48:47,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0018_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000004.tokens
2015-02-12 14:48:47,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:48:47,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742016 for deletion
2015-02-12 14:48:47,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742017_1193 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742017 for deletion
2015-02-12 14:48:47,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742018_1194 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742018 for deletion
2015-02-12 14:48:47,447 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012 for deletion
2015-02-12 14:48:47,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013 for deletion
2015-02-12 14:48:47,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742015_1191 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742015 for deletion
2015-02-12 14:48:47,448 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742017_1193 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742017
2015-02-12 14:48:47,449 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742012_1188 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742012
2015-02-12 14:48:47,449 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742015_1191 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742015
2015-02-12 14:48:47,449 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742016
2015-02-12 14:48:47,450 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742018_1194 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742018
2015-02-12 14:48:47,450 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742013
2015-02-12 14:48:47,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:47,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:47,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:47,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:47,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:47,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar dst=null perm=null proto=rpc
2015-02-12 14:48:47,620 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0018/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:47,621 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0018/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:47,625 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0018/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:47,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:47,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:47,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:47,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:47,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:47,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml dst=null perm=null proto=rpc
2015-02-12 14:48:47,716 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0018/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:47,716 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:47,722 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:47,726 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0018/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:47,726 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:47,729 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0018/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:48:47,730 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:47,731 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:47,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000006 by user soberoi
2015-02-12 14:48:47,734 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000006
2015-02-12 14:48:47,737 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000006 to application application_1423780884992_0018
2015-02-12 14:48:47,737 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:48:47,737 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:47,738 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0018
2015-02-12 14:48:47,738 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:47,738 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0018
2015-02-12 14:48:47,738 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:47,770 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:47,770 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:48:47,771 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0018
2015-02-12 14:48:47,771 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:48:47,771 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0018_01_000007 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@87da94
2015-02-12 14:48:47,789 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:47,789 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:47,793 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:47,793 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:47,807 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:47,807 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:47,817 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:47,817 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:48,021 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000005/default_container_executor.sh]
2015-02-12 14:48:48,021 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000003/default_container_executor.sh]
2015-02-12 14:48:48,030 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000004/default_container_executor.sh]
2015-02-12 14:48:48,031 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000006/default_container_executor.sh]
2015-02-12 14:48:48,218 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:48,219 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000008
2015-02-12 14:48:48,219 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:48:48,725 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:48:48,725 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:48,771 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0018_000001 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096
2015-02-12 14:48:48,771 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0018 unreserved on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:48:48,879 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199
2015-02-12 14:48:48,879 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201
2015-02-12 14:48:48,880 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202
2015-02-12 14:48:48,881 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200
2015-02-12 14:48:49,082 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742022_1198
2015-02-12 14:48:49,083 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742021_1197
2015-02-12 14:48:49,427 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201
2015-02-12 14:48:49,428 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199
2015-02-12 14:48:49,429 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200
2015-02-12 14:48:49,732 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:48:49,732 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:48:49,732 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000008
2015-02-12 14:48:49,732 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:48:49,732 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000008 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:48:49,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199
2015-02-12 14:48:49,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200
2015-02-12 14:48:49,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742025_1201
2015-02-12 14:48:49,876 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202
2015-02-12 14:48:49,926 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742026_1202
2015-02-12 14:48:50,126 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742023_1199
2015-02-12 14:48:50,126 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742024_1200
2015-02-12 14:48:50,224 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0018_01_000008
2015-02-12 14:48:54,087 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203
2015-02-12 14:48:54,436 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204
2015-02-12 14:48:54,437 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203
2015-02-12 14:48:54,880 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204
2015-02-12 14:48:55,133 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742027_1203
2015-02-12 14:48:55,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742028_1204
2015-02-12 14:48:55,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:56,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:56,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:56,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:56,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:56,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job.split dst=null perm=null proto=rpc
2015-02-12 14:48:56,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:56,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:56,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:56,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:48:57,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:48:57,086 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:57,088 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000002
2015-02-12 14:48:57,088 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000002
2015-02-12 14:48:57,088 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:48:57,088 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000002
2015-02-12 14:48:57,108 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:48:57,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205 src: /127.0.0.1:52651 dest: /127.0.0.1:50543
2015-02-12 14:48:57,112 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0018_01_000002 is : 143
2015-02-12 14:48:57,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205 src: /127.0.0.1:52652 dest: /127.0.0.1:50549
2015-02-12 14:48:57,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205 src: /127.0.0.1:52653 dest: /127.0.0.1:50539
2015-02-12 14:48:57,124 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist for DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:48:57,126 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:57,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000002
2015-02-12 14:48:57,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000002
2015-02-12 14:48:57,127 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000002
2015-02-12 14:48:57,127 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000002
2015-02-12 14:48:57,127 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000002
2015-02-12 14:48:57,127 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:57,127 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000002 from application application_1423780884992_0018
2015-02-12 14:48:57,127 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:57,127 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:48:57,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:48:57,420 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:57,422 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000004
2015-02-12 14:48:57,422 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000004
2015-02-12 14:48:57,422 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:48:57,422 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000004
2015-02-12 14:48:57,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:48:57,442 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0018_01_000004 is : 143
2015-02-12 14:48:57,452 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:57,453 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000004
2015-02-12 14:48:57,453 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000004
2015-02-12 14:48:57,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000004
2015-02-12 14:48:57,455 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000004
2015-02-12 14:48:57,455 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000004
2015-02-12 14:48:57,455 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:57,457 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000004 from application application_1423780884992_0018
2015-02-12 14:48:57,457 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:57,457 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:48:57,473 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:57,476 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000006
2015-02-12 14:48:57,476 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000006
2015-02-12 14:48:57,476 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:48:57,477 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000006
2015-02-12 14:48:57,478 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:57,479 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:48:57,479 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000002
2015-02-12 14:48:57,479 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:48:57,479 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000002 on node: host: 10.1.1.67:50575 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:48:57,502 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0018_01_000006 is : 143
2015-02-12 14:48:57,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:48:57,511 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:57,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000006
2015-02-12 14:48:57,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000006
2015-02-12 14:48:57,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000006
2015-02-12 14:48:57,512 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000006
2015-02-12 14:48:57,513 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:57,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000006
2015-02-12 14:48:57,513 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000006 from application application_1423780884992_0018
2015-02-12 14:48:57,513 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:57,513 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:48:57,550 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:57,552 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000003
2015-02-12 14:48:57,552 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000003
2015-02-12 14:48:57,552 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:48:57,552 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000003
2015-02-12 14:48:57,572 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0018_01_000003 is : 143
2015-02-12 14:48:57,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:48:57,585 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:57,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000003
2015-02-12 14:48:57,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000003
2015-02-12 14:48:57,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000003
2015-02-12 14:48:57,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000003
2015-02-12 14:48:57,587 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000003
2015-02-12 14:48:57,587 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:57,587 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000003 from application application_1423780884992_0018
2015-02-12 14:48:57,587 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:57,587 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:48:57,622 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:57,624 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000005
2015-02-12 14:48:57,624 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000005
2015-02-12 14:48:57,624 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:48:57,624 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000005
2015-02-12 14:48:57,650 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0018_01_000005 is : 143
2015-02-12 14:48:57,662 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:48:57,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000005
2015-02-12 14:48:57,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000005
2015-02-12 14:48:57,664 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000005
2015-02-12 14:48:57,664 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:48:57,664 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000005 from application application_1423780884992_0018
2015-02-12 14:48:57,664 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:57,664 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:48:57,665 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000005
2015-02-12 14:48:57,665 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000005
2015-02-12 14:48:58,425 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:58,425 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:48:58,426 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000004
2015-02-12 14:48:58,426 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:58,426 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:58,483 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:58,483 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:58,483 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:48:58,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000006
2015-02-12 14:48:58,483 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:48:58,484 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000006 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:48:58,558 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:58,559 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:48:58,559 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000003
2015-02-12 14:48:58,559 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:58,559 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:58,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:48:58,626 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:48:58,626 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000005
2015-02-12 14:48:58,626 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:48:58,627 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000005 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:48:59,430 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:59,430 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:48:59,431 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000009
2015-02-12 14:48:59,431 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0018_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:48:59,484 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0018_01_000002]
2015-02-12 14:48:59,485 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:59,485 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:59,560 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:59,626 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:48:59,775 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:48:59,786 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:48:59,788 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0018_01_000009 by user soberoi
2015-02-12 14:48:59,788 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000009
2015-02-12 14:48:59,788 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0018_01_000009 to application application_1423780884992_0018
2015-02-12 14:48:59,789 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:48:59,789 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0018
2015-02-12 14:48:59,789 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0018
2015-02-12 14:48:59,789 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:48:59,789 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0018
2015-02-12 14:48:59,790 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:48:59,821 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:48:59,821 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:48:59,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000009/default_container_executor.sh]
2015-02-12 14:49:00,430 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0018_01_000004]
2015-02-12 14:49:00,430 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:00,430 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:00,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0018_01_000006]
2015-02-12 14:49:00,486 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:00,561 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0018_01_000003]
2015-02-12 14:49:00,561 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:00,629 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0018_01_000005]
2015-02-12 14:49:00,629 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:00,779 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:49:02,311 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:02,314 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:02,316 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:02,318 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:02,325 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:02,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,594 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:49:02,687 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206 src: /127.0.0.1:52666 dest: /127.0.0.1:50543
2015-02-12 14:49:02,689 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206 src: /127.0.0.1:52667 dest: /127.0.0.1:50549
2015-02-12 14:49:02,693 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206 src: /127.0.0.1:52668 dest: /127.0.0.1:50539
2015-02-12 14:49:02,730 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52668, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0018_r_000000_0_1641465179_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206, duration: 34866000
2015-02-12 14:49:02,730 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:02,731 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,731 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52667, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0018_r_000000_0_1641465179_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206, duration: 35820000
2015-02-12 14:49:02,731 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,732 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52666, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0018_r_000000_0_1641465179_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206, duration: 36777000
2015-02-12 14:49:02,732 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,732 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,733 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,744 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0018_r_000000_0_1641465179_1
2015-02-12 14:49:02,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:49:02,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:49:02,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/task_1423780884992_0018_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:49:02,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1423780884992_0018_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/task_1423780884992_0018_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:49:02,789 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:49:02,791 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000009
2015-02-12 14:49:02,791 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000009
2015-02-12 14:49:02,791 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:49:02,792 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000009
2015-02-12 14:49:02,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,806 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:49:02,818 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0018_01_000009 is : 143
2015-02-12 14:49:02,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:02,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:02,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/task_1423780884992_0018_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:49:02,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:02,833 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:02,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary/1/task_1423780884992_0018_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000009
2015-02-12 14:49:02,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000009
2015-02-12 14:49:02,834 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000009
2015-02-12 14:49:02,834 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:02,834 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000009 from application application_1423780884992_0018
2015-02-12 14:49:02,834 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:02,835 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:49:02,835 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000009
2015-02-12 14:49:02,835 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000009
2015-02-12 14:49:02,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary dst=null perm=null proto=rpc
2015-02-12 14:49:02,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,847 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,851 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,867 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52653, dest: /127.0.0.1:50539, bytes: 68406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205, duration: 5748309000
2015-02-12 14:49:02,867 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:02,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16362
2015-02-12 14:49:02,868 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52652, dest: /127.0.0.1:50549, bytes: 68406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205, duration: 5748286000
2015-02-12 14:49:02,868 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,871 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16362
2015-02-12 14:49:02,872 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52651, dest: /127.0.0.1:50543, bytes: 68406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205, duration: 5752980000
2015-02-12 14:49:02,872 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,873 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16362
2015-02-12 14:49:02,874 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,880 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:49:02,884 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207 src: /127.0.0.1:52670 dest: /127.0.0.1:50543
2015-02-12 14:49:02,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207 src: /127.0.0.1:52671 dest: /127.0.0.1:50546
2015-02-12 14:49:02,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207 src: /127.0.0.1:52672 dest: /127.0.0.1:50549
2015-02-12 14:49:02,897 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52672, dest: /127.0.0.1:50549, bytes: 449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207, duration: 2779000
2015-02-12 14:49:02,897 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:02,898 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:49:02,898 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52671, dest: /127.0.0.1:50546, bytes: 449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207, duration: 2512000
2015-02-12 14:49:02,898 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,899 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52670, dest: /127.0.0.1:50543, bytes: 449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207, duration: 4422000
2015-02-12 14:49:02,899 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:49:02,899 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,899 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,908 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:02,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:49:02,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:02,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:49:02,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:02,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:49:02,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,937 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:49:02,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208 src: /127.0.0.1:52674 dest: /127.0.0.1:50543
2015-02-12 14:49:02,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208 src: /127.0.0.1:52675 dest: /127.0.0.1:50546
2015-02-12 14:49:02,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208 src: /127.0.0.1:52676 dest: /127.0.0.1:50539
2015-02-12 14:49:02,951 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52676, dest: /127.0.0.1:50539, bytes: 68406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208, duration: 2349000
2015-02-12 14:49:02,951 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:02,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:49:02,952 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52675, dest: /127.0.0.1:50546, bytes: 68406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208, duration: 3234000
2015-02-12 14:49:02,952 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,953 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52674, dest: /127.0.0.1:50543, bytes: 68406, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208, duration: 4772000
2015-02-12 14:49:02,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,953 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,955 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,956 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:02,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:49:02,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:02,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:49:02,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:02,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018/job_1423780884992_0018_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:49:02,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:02,975 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:49:02,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209 src: /127.0.0.1:52678 dest: /127.0.0.1:50539
2015-02-12 14:49:02,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209 src: /127.0.0.1:52679 dest: /127.0.0.1:50549
2015-02-12 14:49:02,979 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209 src: /127.0.0.1:52680 dest: /127.0.0.1:50546
2015-02-12 14:49:02,986 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52680, dest: /127.0.0.1:50546, bytes: 113387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209, duration: 3798000
2015-02-12 14:49:02,986 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:02,987 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:49:02,987 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52679, dest: /127.0.0.1:50549, bytes: 113387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209, duration: 4381000
2015-02-12 14:49:02,987 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,988 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52678, dest: /127.0.0.1:50539, bytes: 113387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1885138206_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209, duration: 6023000
2015-02-12 14:49:02,989 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:02,990 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:02,991 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1885138206_1
2015-02-12 14:49:02,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:02,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:03,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:03,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:03,016 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0018_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:49:03,016 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:49:03,016 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0018 with final state: FINISHING
2015-02-12 14:49:03,016 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from RUNNING to FINAL_SAVING
2015-02-12 14:49:03,018 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:49:03,018 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0018
2015-02-12 14:49:03,020 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from FINAL_SAVING to FINISHING
2015-02-12 14:49:03,795 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:03,796 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:49:03,796 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000009
2015-02-12 14:49:03,796 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:49:03,796 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000009 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:49:04,019 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0018 unregistered successfully.
2015-02-12 14:49:04,023 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742023_1199 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:49:04,023 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742024_1200 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:49:04,024 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742025_1201 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:49:04,024 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742026_1202 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:49:04,024 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742028_1204 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:49:04,024 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742029_1205 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:49:04,025 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742027_1203 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:49:04,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0018 dst=null perm=null proto=rpc
2015-02-12 14:49:04,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,067 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary
2015-02-12 14:49:04,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/_temporary dst=null perm=null proto=rpc
2015-02-12 14:49:04,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,082 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:04,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:04,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,103 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:04,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:04,107 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/samepipe
2015-02-12 14:49:04,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe dst=null perm=null proto=rpc
2015-02-12 14:49:04,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:04,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samepipe/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:04,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,132 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:49:04,133 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:49:04,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:04,149 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:49:04,150 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:49:04,150 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:49:04,150 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone"]
2015-02-12 14:49:04,150 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:49:04,150 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:49:04,150 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:49:04,152 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dedpipesplatform/joinnone
2015-02-12 14:49:04,163 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:49:04,174 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:49:04,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:04,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:04,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:04,180 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 19
2015-02-12 14:49:04,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019 dst=null perm=null proto=rpc
2015-02-12 14:49:04,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:49:04,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:49:04,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,189 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:49:04,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 src: /127.0.0.1:52685 dest: /127.0.0.1:50549
2015-02-12 14:49:04,192 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 src: /127.0.0.1:52686 dest: /127.0.0.1:50546
2015-02-12 14:49:04,194 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 src: /127.0.0.1:52687 dest: /127.0.0.1:50543
2015-02-12 14:49:04,202 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52687, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210, duration: 3691000
2015-02-12 14:49:04,202 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:04,202 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:49:04,203 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52686, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210, duration: 5160000
2015-02-12 14:49:04,203 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,204 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52685, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210, duration: 5480000
2015-02-12 14:49:04,204 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,204 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,210 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,212 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:04,213 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar
2015-02-12 14:49:04,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:49:04,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:49:04,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:49:04,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:49:04,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:49:04,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,231 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:04,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,233 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:04,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,235 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:04,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,238 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:04,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:04,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,243 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split
2015-02-12 14:49:04,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:04,244 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:49:04,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211 src: /127.0.0.1:52688 dest: /127.0.0.1:50543
2015-02-12 14:49:04,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211 src: /127.0.0.1:52689 dest: /127.0.0.1:50539
2015-02-12 14:49:04,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211 src: /127.0.0.1:52690 dest: /127.0.0.1:50549
2015-02-12 14:49:04,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211 src: /127.0.0.1:52691 dest: /127.0.0.1:50546
2015-02-12 14:49:04,252 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52691, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, duration: 1603000
2015-02-12 14:49:04,252 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:04,254 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,254 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52690, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, duration: 2352000
2015-02-12 14:49:04,255 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,256 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52689, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, duration: 5394000
2015-02-12 14:49:04,257 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,257 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52688, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, duration: 6657000
2015-02-12 14:49:04,258 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,258 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,261 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:04,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,269 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:49:04,270 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212 src: /127.0.0.1:52692 dest: /127.0.0.1:50549
2015-02-12 14:49:04,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212 src: /127.0.0.1:52693 dest: /127.0.0.1:50539
2015-02-12 14:49:04,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212 src: /127.0.0.1:52694 dest: /127.0.0.1:50543
2015-02-12 14:49:04,279 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52694, dest: /127.0.0.1:50543, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212, duration: 1187000
2015-02-12 14:49:04,280 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:04,280 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52693, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212, duration: 1545000
2015-02-12 14:49:04,280 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,280 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:49:04,281 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52692, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212, duration: 2978000
2015-02-12 14:49:04,282 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,282 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,285 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:04,286 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:49:04,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:04,295 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:49:04,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213 src: /127.0.0.1:52695 dest: /127.0.0.1:50539
2015-02-12 14:49:04,298 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213 src: /127.0.0.1:52696 dest: /127.0.0.1:50543
2015-02-12 14:49:04,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213 src: /127.0.0.1:52697 dest: /127.0.0.1:50549
2015-02-12 14:49:04,302 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52697, dest: /127.0.0.1:50549, bytes: 97228, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213, duration: 1568000
2015-02-12 14:49:04,302 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:04,303 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:49:04,303 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52696, dest: /127.0.0.1:50543, bytes: 97228, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213, duration: 2129000
2015-02-12 14:49:04,303 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,305 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,305 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52695, dest: /127.0.0.1:50539, bytes: 97228, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213, duration: 3820000
2015-02-12 14:49:04,306 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:04,308 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:04,309 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:04,310 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0019
2015-02-12 14:49:04,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019 dst=null perm=null proto=rpc
2015-02-12 14:49:04,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:04,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:04,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:04,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:04,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:04,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:04,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,333 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 19 submitted by user soberoi
2015-02-12 14:49:04,333 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0019
2015-02-12 14:49:04,333 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from NEW to NEW_SAVING
2015-02-12 14:49:04,333 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0019
2015-02-12 14:49:04,333 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0019
2015-02-12 14:49:04,334 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:49:04,334 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0019 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:49:04,334 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from SUBMITTED to ACCEPTED
2015-02-12 14:49:04,334 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0019_000001
2015-02-12 14:49:04,334 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from NEW to SUBMITTED
2015-02-12 14:49:04,335 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0019_000001 to scheduler from user: soberoi
2015-02-12 14:49:04,335 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0019
2015-02-12 14:49:04,335 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:49:04,337 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0019/
2015-02-12 14:49:04,337 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0019
2015-02-12 14:49:04,337 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0019/
2015-02-12 14:49:04,499 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:04,499 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000001
2015-02-12 14:49:04,499 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:49:04,500 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0019_01_000001
2015-02-12 14:49:04,500 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:04,500 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0019_000001
2015-02-12 14:49:04,500 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0019 AttemptId: appattempt_1423780884992_0019_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0019_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:49:04,501 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:49:04,501 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:49:04,501 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0019_000001
2015-02-12 14:49:04,502 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0019_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0019_000001
2015-02-12 14:49:04,502 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0019_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:49:04,502 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0019_000001
2015-02-12 14:49:04,502 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0019_000001
2015-02-12 14:49:04,504 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:04,506 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000001 by user soberoi
2015-02-12 14:49:04,507 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0019
2015-02-12 14:49:04,507 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000001
2015-02-12 14:49:04,507 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from NEW to INITING
2015-02-12 14:49:04,507 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000001 to application application_1423780884992_0019
2015-02-12 14:49:04,507 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from INITING to RUNNING
2015-02-12 14:49:04,507 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0019_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0019_000001
2015-02-12 14:49:04,508 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:49:04,508 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:49:04,508 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:04,508 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:04,508 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:49:04,508 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:49:04,508 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:04,509 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0019_01_000001
2015-02-12 14:49:04,518 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0019_01_000001.tokens. Credentials list:
2015-02-12 14:49:04,626 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:04,719 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0019_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000001.tokens
2015-02-12 14:49:04,720 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:04,798 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:04,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:04,844 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0019/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:04,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:04,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:04,908 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0019/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:04,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:04,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:04,971 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:04,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:04,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:05,026 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0019/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:05,026 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:05,070 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:05,070 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:05,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000001/default_container_executor.sh]
2015-02-12 14:49:05,500 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:05,802 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:06,805 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:06,991 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50543 to replicate blk_1073742034_1210 to datanode(s) 127.0.0.1:50539
2015-02-12 14:49:06,991 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742023_1199, blk_1073742024_1200, blk_1073742026_1202, blk_1073742027_1203, blk_1073742028_1204, blk_1073742029_1205]
2015-02-12 14:49:06,991 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742023_1199, blk_1073742024_1200, blk_1073742025_1201, blk_1073742026_1202, blk_1073742027_1203, blk_1073742029_1205]
2015-02-12 14:49:07,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:07,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:49:07,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:49:07,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:49:07,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019 dst=null perm=null proto=rpc
2015-02-12 14:49:07,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:49:07,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:49:07,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:07,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:07,806 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:07,854 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 to 127.0.0.1:50539
2015-02-12 14:49:07,854 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023 for deletion
2015-02-12 14:49:07,854 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024 for deletion
2015-02-12 14:49:07,854 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742025_1201 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742025 for deletion
2015-02-12 14:49:07,855 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742026 for deletion
2015-02-12 14:49:07,855 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742027_1203 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742027 for deletion
2015-02-12 14:49:07,855 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742029 for deletion
2015-02-12 14:49:07,856 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023
2015-02-12 14:49:07,856 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:49:07,856 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742025_1201 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742025
2015-02-12 14:49:07,856 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742027_1203 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742027
2015-02-12 14:49:07,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 src: /127.0.0.1:52720 dest: /127.0.0.1:50539
2015-02-12 14:49:07,856 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024
2015-02-12 14:49:07,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742026
2015-02-12 14:49:07,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742029
2015-02-12 14:49:07,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210 src: /127.0.0.1:52720 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:49:07,859 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742034_1210 size 254067
2015-02-12 14:49:08,457 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023 for deletion
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024 for deletion
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742026 for deletion
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742027_1203 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742027 for deletion
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742028_1204 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742028 for deletion
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742029 for deletion
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742026
2015-02-12 14:49:08,458 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742027_1203 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742027
2015-02-12 14:49:08,459 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742028_1204 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742028
2015-02-12 14:49:08,459 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742029
2015-02-12 14:49:08,474 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:08,475 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0019_000001
2015-02-12 14:49:08,476 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0019 APPATTEMPTID=appattempt_1423780884992_0019_000001
2015-02-12 14:49:08,476 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:49:08,476 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from ACCEPTED to RUNNING
2015-02-12 14:49:08,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:08,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:49:08,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:08,811 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:08,876 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:49:08,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214 src: /127.0.0.1:52724 dest: /127.0.0.1:50546
2015-02-12 14:49:08,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214 src: /127.0.0.1:52725 dest: /127.0.0.1:50549
2015-02-12 14:49:08,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214 src: /127.0.0.1:52726 dest: /127.0.0.1:50539
2015-02-12 14:49:08,970 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52726, dest: /127.0.0.1:50539, bytes: 113943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214, duration: 33519000
2015-02-12 14:49:08,970 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:08,971 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:49:08,971 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52725, dest: /127.0.0.1:50549, bytes: 113943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214, duration: 34718000
2015-02-12 14:49:08,971 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:08,971 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:08,972 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52724, dest: /127.0.0.1:50546, bytes: 113943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214, duration: 35365000
2015-02-12 14:49:08,972 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:08,972 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:08,976 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:09,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:09,016 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:49:09,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215 src: /127.0.0.1:52727 dest: /127.0.0.1:50546
2015-02-12 14:49:09,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215 src: /127.0.0.1:52728 dest: /127.0.0.1:50549
2015-02-12 14:49:09,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215 src: /127.0.0.1:52729 dest: /127.0.0.1:50539
2015-02-12 14:49:09,024 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52729, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215, duration: 1417000
2015-02-12 14:49:09,024 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:09,025 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:49:09,025 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52728, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215, duration: 2343000
2015-02-12 14:49:09,025 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:09,026 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:09,026 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52727, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215, duration: 3279000
2015-02-12 14:49:09,026 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:09,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:09,030 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019.summary is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:09,086 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0018_01_000001 succeeded
2015-02-12 14:49:09,086 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:49:09,086 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0018_01_000001
2015-02-12 14:49:09,104 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206
2015-02-12 14:49:09,105 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208
2015-02-12 14:49:09,106 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207
2015-02-12 14:49:09,109 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000001
2015-02-12 14:49:09,109 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0018_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:49:09,109 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000001
2015-02-12 14:49:09,109 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000001
2015-02-12 14:49:09,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000001
2015-02-12 14:49:09,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0018/container_1423780884992_0018_01_000001
2015-02-12 14:49:09,110 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0018_01_000001 from application application_1423780884992_0018
2015-02-12 14:49:09,111 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:09,111 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0018
2015-02-12 14:49:09,454 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208
2015-02-12 14:49:09,455 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742029_1205
2015-02-12 14:49:09,456 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209
2015-02-12 14:49:09,456 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211
2015-02-12 14:49:09,456 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206
2015-02-12 14:49:09,456 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212
2015-02-12 14:49:09,514 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0018_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:09,514 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0018_000001
2015-02-12 14:49:09,514 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0018_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:49:09,514 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0018_000001
2015-02-12 14:49:09,514 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000001
2015-02-12 14:49:09,514 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0018_000001 State change from FINISHING to FINISHED
2015-02-12 14:49:09,514 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0018 State change from FINISHING to FINISHED
2015-02-12 14:49:09,514 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0018_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:49:09,515 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0018_000001
2015-02-12 14:49:09,515 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0018
2015-02-12 14:49:09,515 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0018,name=[183C996BCE40452C9738BB9E64A20F82/0340FE90E302444D9B25DBA542D070E2] lower/(1/1) ...dedpipesplatform/samepipe,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0018/jobhistory/job/job_1423780884992_0018,appMasterHost=10.1.1.67,startTime=1423781320313,finishTime=1423781343016,finalStatus=SUCCEEDED
2015-02-12 14:49:09,515 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0018_000001 released container container_1423780884992_0018_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:49:09,515 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0018_000001 is done. finalState=FINISHED
2015-02-12 14:49:09,515 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0018 requests cleared
2015-02-12 14:49:09,523 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0018_000001 (auth:SIMPLE)
2015-02-12 14:49:09,525 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0018_01_000001
2015-02-12 14:49:09,525 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0018 CONTAINERID=container_1423780884992_0018_01_000001
2015-02-12 14:49:09,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0018_01_000001]
2015-02-12 14:49:09,525 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:09,526 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:09,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,526 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0018
2015-02-12 14:49:09,527 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:09,527 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0018, with delay of 10800 seconds
2015-02-12 14:49:09,527 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,568 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30002 milliseconds
2015-02-12 14:49:09,568 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:49:09,585 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:09,586 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:09,586 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000002
2015-02-12 14:49:09,586 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:49:09,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,587 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0018
2015-02-12 14:49:09,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,588 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,587 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:09,588 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0018, with delay of 10800 seconds
2015-02-12 14:49:09,659 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213
2015-02-12 14:49:09,668 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:09,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:09,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,669 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000003
2015-02-12 14:49:09,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,669 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:49:09,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,671 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0018
2015-02-12 14:49:09,671 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:09,671 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0018, with delay of 10800 seconds
2015-02-12 14:49:09,812 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:09,812 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:09,813 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:09,813 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,813 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000004
2015-02-12 14:49:09,813 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:49:09,814 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0018
2015-02-12 14:49:09,814 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:09,814 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0018, with delay of 10800 seconds
2015-02-12 14:49:09,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,815 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0018
2015-02-12 14:49:09,895 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207
2015-02-12 14:49:09,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209
2015-02-12 14:49:09,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211
2015-02-12 14:49:09,995 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742023_1199, blk_1073742024_1200, blk_1073742025_1201, blk_1073742027_1203, blk_1073742028_1204, blk_1073742029_1205]
2015-02-12 14:49:09,995 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742023_1199, blk_1073742024_1200, blk_1073742025_1201, blk_1073742026_1202, blk_1073742028_1204]
2015-02-12 14:49:10,100 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210
2015-02-12 14:49:10,101 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742032_1208
2015-02-12 14:49:10,146 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742033_1209
2015-02-12 14:49:10,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211
2015-02-12 14:49:10,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742031_1207
2015-02-12 14:49:10,351 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210
2015-02-12 14:49:10,351 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742030_1206
2015-02-12 14:49:10,352 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212
2015-02-12 14:49:10,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:10,530 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000005
2015-02-12 14:49:10,530 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:49:10,551 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213
2015-02-12 14:49:10,560 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0019_01_000002
2015-02-12 14:49:10,560 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:10,561 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0019_01_000003
2015-02-12 14:49:10,561 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:10,561 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0019_01_000004
2015-02-12 14:49:10,562 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:10,562 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0019_01_000005
2015-02-12 14:49:10,563 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:10,589 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:10,589 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000006
2015-02-12 14:49:10,589 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:49:10,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:10,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:10,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:10,669 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:10,669 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000007
2015-02-12 14:49:10,670 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:49:10,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:10,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:10,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:10,715 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:10,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000004 by user soberoi
2015-02-12 14:49:10,718 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0019
2015-02-12 14:49:10,718 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000004
2015-02-12 14:49:10,718 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000005 by user soberoi
2015-02-12 14:49:10,719 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000002 by user soberoi
2015-02-12 14:49:10,719 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000005
2015-02-12 14:49:10,719 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0019
2015-02-12 14:49:10,720 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000002
2015-02-12 14:49:10,720 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000003 by user soberoi
2015-02-12 14:49:10,720 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from NEW to INITING
2015-02-12 14:49:10,720 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000004 to application application_1423780884992_0019
2015-02-12 14:49:10,721 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from INITING to RUNNING
2015-02-12 14:49:10,721 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:49:10,722 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000005 to application application_1423780884992_0019
2015-02-12 14:49:10,722 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from NEW to INITING
2015-02-12 14:49:10,722 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000002 to application application_1423780884992_0019
2015-02-12 14:49:10,723 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from INITING to RUNNING
2015-02-12 14:49:10,723 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:49:10,723 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,723 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,723 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:10,723 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,723 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,723 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:10,724 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:10,722 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0019
2015-02-12 14:49:10,725 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000003
2015-02-12 14:49:10,725 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from NEW to INITING
2015-02-12 14:49:10,725 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000003 to application application_1423780884992_0019
2015-02-12 14:49:10,725 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from INITING to RUNNING
2015-02-12 14:49:10,726 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:49:10,726 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,726 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,726 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:10,726 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:10,724 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:10,726 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:10,726 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:10,726 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:10,723 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:10,727 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0019_01_000003
2015-02-12 14:49:10,727 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:10,723 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:49:10,727 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,727 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:10,728 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:10,728 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:10,728 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:10,728 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:10,728 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0019_01_000002
2015-02-12 14:49:10,726 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0019_01_000004
2015-02-12 14:49:10,755 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0019_01_000003.tokens. Credentials list:
2015-02-12 14:49:10,755 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0019_01_000004.tokens. Credentials list:
2015-02-12 14:49:10,756 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0019_01_000002.tokens. Credentials list:
2015-02-12 14:49:10,794 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:10,794 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:10,815 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:10,815 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:10,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023 for deletion
2015-02-12 14:49:10,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024 for deletion
2015-02-12 14:49:10,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742025_1201 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742025 for deletion
2015-02-12 14:49:10,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742027_1203 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742027 for deletion
2015-02-12 14:49:10,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742028_1204 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742028 for deletion
2015-02-12 14:49:10,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742029 for deletion
2015-02-12 14:49:10,859 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023
2015-02-12 14:49:10,859 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742025_1201 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742025
2015-02-12 14:49:10,859 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742028_1204 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742028
2015-02-12 14:49:10,859 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024
2015-02-12 14:49:10,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742027_1203 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742027
2015-02-12 14:49:10,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742029
2015-02-12 14:49:10,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:10,998 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:11,001 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:11,043 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000005/default_container_executor.sh]
2015-02-12 14:49:11,170 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0019_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000002.tokens
2015-02-12 14:49:11,171 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:11,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0019_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000004.tokens
2015-02-12 14:49:11,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:11,187 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0019_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000003.tokens
2015-02-12 14:49:11,187 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:11,197 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023 for deletion
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024 for deletion
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742025_1201 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742025 for deletion
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742026 for deletion
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742028_1204 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742028 for deletion
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742023
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742024_1200 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742024
2015-02-12 14:49:11,198 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742025_1201 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742025
2015-02-12 14:49:11,199 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742026
2015-02-12 14:49:11,199 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742028_1204 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742028
2015-02-12 14:49:11,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:11,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:11,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:11,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:11,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:11,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:11,421 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0019/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:11,429 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0019/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:11,444 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0019/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:11,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:11,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:11,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:11,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:11,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:11,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:11,531 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:11,534 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0019/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:11,534 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:11,553 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:11,553 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:11,562 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0019/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:11,563 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:11,575 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:11,575 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:11,586 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:11,586 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:11,588 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000007 by user soberoi
2015-02-12 14:49:11,588 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000006 by user soberoi
2015-02-12 14:49:11,589 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000007 to application application_1423780884992_0019
2015-02-12 14:49:11,589 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000006
2015-02-12 14:49:11,589 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:49:11,589 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:11,589 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:11,589 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:11,589 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:11,589 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000007
2015-02-12 14:49:11,590 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:11,590 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000006 to application application_1423780884992_0019
2015-02-12 14:49:11,590 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:49:11,590 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:11,590 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:11,590 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:11,591 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:11,591 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:11,592 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:11,592 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:11,592 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:11,592 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000008
2015-02-12 14:49:11,592 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:49:11,643 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:11,643 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:11,644 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:11,644 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:11,644 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:11,644 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:11,669 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:11,670 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:11,670 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:11,670 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000009
2015-02-12 14:49:11,670 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:49:11,682 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:11,682 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:11,684 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:11,685 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:11,874 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000002/default_container_executor.sh]
2015-02-12 14:49:11,874 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000004/default_container_executor.sh]
2015-02-12 14:49:11,882 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000003/default_container_executor.sh]
2015-02-12 14:49:11,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000007/default_container_executor.sh]
2015-02-12 14:49:11,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000006/default_container_executor.sh]
2015-02-12 14:49:12,579 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:49:12,580 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:12,580 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:13,588 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:49:13,588 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:49:13,588 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000008
2015-02-12 14:49:13,588 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:49:13,588 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000008 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:49:13,589 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:49:13,589 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:49:13,589 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000009
2015-02-12 14:49:13,589 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:49:13,589 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000009 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:49:13,597 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0019_01_000008
2015-02-12 14:49:13,671 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0019_01_000009
2015-02-12 14:49:14,112 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210
2015-02-12 14:49:14,112 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742035_1211
2015-02-12 14:49:14,113 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742036_1212
2015-02-12 14:49:14,316 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742037_1213
2015-02-12 14:49:14,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215
2015-02-12 14:49:14,666 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742034_1210
2015-02-12 14:49:14,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214
2015-02-12 14:49:15,106 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214
2015-02-12 14:49:15,106 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215
2015-02-12 14:49:15,555 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742039_1215
2015-02-12 14:49:15,556 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742038_1214
2015-02-12 14:49:21,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:21,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:21,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:21,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:21,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:21,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:21,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:22,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:22,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:22,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:22,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:22,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:22,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:49:22,686 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:22,687 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000005
2015-02-12 14:49:22,687 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000005
2015-02-12 14:49:22,687 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:49:22,688 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000005
2015-02-12 14:49:22,710 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000005 is : 143
2015-02-12 14:49:22,712 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:49:22,716 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216 src: /127.0.0.1:52769 dest: /127.0.0.1:50546
2015-02-12 14:49:22,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216 src: /127.0.0.1:52770 dest: /127.0.0.1:50543
2015-02-12 14:49:22,722 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:22,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216 src: /127.0.0.1:52771 dest: /127.0.0.1:50539
2015-02-12 14:49:22,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000005
2015-02-12 14:49:22,723 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000005
2015-02-12 14:49:22,723 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000005
2015-02-12 14:49:22,723 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000005
2015-02-12 14:49:22,723 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000005
2015-02-12 14:49:22,723 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:22,724 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000005 from application application_1423780884992_0019
2015-02-12 14:49:22,724 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:22,724 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:22,730 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist for DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:22,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:49:22,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:49:22,933 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:22,934 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000003
2015-02-12 14:49:22,935 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000003
2015-02-12 14:49:22,935 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:49:22,935 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000003
2015-02-12 14:49:22,954 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000003 is : 143
2015-02-12 14:49:22,965 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:22,965 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000003
2015-02-12 14:49:22,965 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000003
2015-02-12 14:49:22,966 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000003
2015-02-12 14:49:22,966 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:22,966 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000003 from application application_1423780884992_0019
2015-02-12 14:49:22,966 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:22,966 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:22,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000003
2015-02-12 14:49:22,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000003
2015-02-12 14:49:22,985 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:22,988 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000006
2015-02-12 14:49:22,988 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000006
2015-02-12 14:49:22,988 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:49:22,989 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000006
2015-02-12 14:49:23,014 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000006 is : 143
2015-02-12 14:49:23,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:49:23,023 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:23,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000006
2015-02-12 14:49:23,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000006
2015-02-12 14:49:23,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000006
2015-02-12 14:49:23,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000006
2015-02-12 14:49:23,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000006
2015-02-12 14:49:23,026 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:23,026 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000006 from application application_1423780884992_0019
2015-02-12 14:49:23,027 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:23,027 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:23,058 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:23,060 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000004
2015-02-12 14:49:23,060 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000004
2015-02-12 14:49:23,060 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:49:23,060 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000004
2015-02-12 14:49:23,081 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000004 is : 143
2015-02-12 14:49:23,090 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:23,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000004
2015-02-12 14:49:23,095 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000004
2015-02-12 14:49:23,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000004
2015-02-12 14:49:23,103 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000004
2015-02-12 14:49:23,103 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000004
2015-02-12 14:49:23,104 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:23,104 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000004 from application application_1423780884992_0019
2015-02-12 14:49:23,104 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:23,104 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:23,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:49:23,195 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:23,197 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000002
2015-02-12 14:49:23,197 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000002
2015-02-12 14:49:23,198 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:49:23,198 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000002
2015-02-12 14:49:23,198 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:23,199 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:49:23,199 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000006
2015-02-12 14:49:23,199 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:49:23,199 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000006 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:49:23,224 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000002 is : 143
2015-02-12 14:49:23,235 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:23,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000002
2015-02-12 14:49:23,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000002
2015-02-12 14:49:23,239 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000002
2015-02-12 14:49:23,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000002
2015-02-12 14:49:23,241 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000002
2015-02-12 14:49:23,241 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:23,241 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000002 from application application_1423780884992_0019
2015-02-12 14:49:23,241 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:23,241 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:23,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:49:23,289 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:23,291 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000007
2015-02-12 14:49:23,291 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000007
2015-02-12 14:49:23,291 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:49:23,292 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000007
2015-02-12 14:49:23,293 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:23,293 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:49:23,293 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000003
2015-02-12 14:49:23,293 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:49:23,293 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000003 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:49:23,313 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000007 is : 143
2015-02-12 14:49:23,328 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:23,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000007
2015-02-12 14:49:23,330 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000007
2015-02-12 14:49:23,330 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000007
2015-02-12 14:49:23,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000007
2015-02-12 14:49:23,339 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000007
2015-02-12 14:49:23,340 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:23,340 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000007 from application application_1423780884992_0019
2015-02-12 14:49:23,340 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:23,341 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:23,693 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:23,693 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:49:23,693 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000005
2015-02-12 14:49:23,694 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:49:23,694 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000005 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:49:24,066 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:24,066 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:49:24,067 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000004
2015-02-12 14:49:24,067 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:49:24,067 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:49:24,203 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:24,203 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:49:24,203 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000002
2015-02-12 14:49:24,203 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:49:24,203 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000002 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:49:24,204 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:24,294 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:24,294 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:24,294 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:49:24,294 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000007
2015-02-12 14:49:24,294 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:49:24,295 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000007 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:49:24,696 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:24,697 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:24,697 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000010
2015-02-12 14:49:24,697 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0019_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:49:25,068 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:25,205 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000006]
2015-02-12 14:49:25,205 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:25,205 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:25,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000003]
2015-02-12 14:49:25,298 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:25,298 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:25,643 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:25,653 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:25,655 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0019_01_000010 by user soberoi
2015-02-12 14:49:25,656 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000010
2015-02-12 14:49:25,656 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0019_01_000010 to application application_1423780884992_0019
2015-02-12 14:49:25,656 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 14:49:25,656 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0019
2015-02-12 14:49:25,656 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0019
2015-02-12 14:49:25,656 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:25,656 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0019
2015-02-12 14:49:25,657 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:25,687 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:25,687 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:25,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000005]
2015-02-12 14:49:25,698 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:25,699 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:25,793 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000010/default_container_executor.sh]
2015-02-12 14:49:26,073 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000004]
2015-02-12 14:49:26,073 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:26,208 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000002]
2015-02-12 14:49:26,209 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:26,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000007]
2015-02-12 14:49:26,301 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:26,646 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:49:28,194 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:28,197 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:28,199 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:28,202 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:28,209 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:49:28,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,476 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:49:28,572 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217 src: /127.0.0.1:52787 dest: /127.0.0.1:50549
2015-02-12 14:49:28,574 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217 src: /127.0.0.1:52788 dest: /127.0.0.1:50543
2015-02-12 14:49:28,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217 src: /127.0.0.1:52789 dest: /127.0.0.1:50539
2015-02-12 14:49:28,622 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52789, dest: /127.0.0.1:50539, bytes: 200, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0019_r_000000_0_1107949415_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217, duration: 45550000
2015-02-12 14:49:28,623 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:28,624 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52788, dest: /127.0.0.1:50543, bytes: 200, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0019_r_000000_0_1107949415_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217, duration: 47356000
2015-02-12 14:49:28,625 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,626 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52787, dest: /127.0.0.1:50549, bytes: 200, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0019_r_000000_0_1107949415_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217, duration: 49247000
2015-02-12 14:49:28,626 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,628 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,629 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,631 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0019_r_000000_0_1107949415_1
2015-02-12 14:49:28,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:49:28,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:49:28,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/task_1423780884992_0019_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:49:28,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1423780884992_0019_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/task_1423780884992_0019_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:49:28,675 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:28,679 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000010
2015-02-12 14:49:28,679 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000010
2015-02-12 14:49:28,680 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000010 transitioned from RUNNING to KILLING
2015-02-12 14:49:28,680 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000010
2015-02-12 14:49:28,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,702 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:49:28,714 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0019_01_000010 is : 143
2015-02-12 14:49:28,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:28,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:28,723 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:49:28,725 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000010
2015-02-12 14:49:28,725 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:49:28,725 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000010 from application application_1423780884992_0019
2015-02-12 14:49:28,725 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:28,726 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:28,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000010
2015-02-12 14:49:28,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000010
2015-02-12 14:49:28,727 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000010
2015-02-12 14:49:28,728 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000010
2015-02-12 14:49:28,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/task_1423780884992_0019_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:49:28,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:28,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary/1/task_1423780884992_0019_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary dst=null perm=null proto=rpc
2015-02-12 14:49:28,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,756 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,763 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,806 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52771, dest: /127.0.0.1:50539, bytes: 75556, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216, duration: 6081889000
2015-02-12 14:49:28,806 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:28,809 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52770, dest: /127.0.0.1:50543, bytes: 75556, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216, duration: 6081871000
2015-02-12 14:49:28,809 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 17019
2015-02-12 14:49:28,811 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,812 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 17019
2015-02-12 14:49:28,813 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52769, dest: /127.0.0.1:50546, bytes: 75556, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216, duration: 6087183000
2015-02-12 14:49:28,813 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,814 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 17019
2015-02-12 14:49:28,841 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,847 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:49:28,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218 src: /127.0.0.1:52791 dest: /127.0.0.1:50543
2015-02-12 14:49:28,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218 src: /127.0.0.1:52792 dest: /127.0.0.1:50549
2015-02-12 14:49:28,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218 src: /127.0.0.1:52793 dest: /127.0.0.1:50546
2015-02-12 14:49:28,856 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52793, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218, duration: 1565000
2015-02-12 14:49:28,857 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:28,857 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,858 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52792, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218, duration: 2452000
2015-02-12 14:49:28,858 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,862 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52791, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218, duration: 6244000
2015-02-12 14:49:28,862 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,862 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,863 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,865 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:28,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:49:28,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:28,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:49:28,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:28,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:49:28,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,898 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:49:28,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219 src: /127.0.0.1:52795 dest: /127.0.0.1:50539
2015-02-12 14:49:28,903 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219 src: /127.0.0.1:52796 dest: /127.0.0.1:50549
2015-02-12 14:49:28,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219 src: /127.0.0.1:52797 dest: /127.0.0.1:50543
2015-02-12 14:49:28,913 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52797, dest: /127.0.0.1:50543, bytes: 75556, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219, duration: 5156000
2015-02-12 14:49:28,913 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:28,913 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,913 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52796, dest: /127.0.0.1:50549, bytes: 75556, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219, duration: 5821000
2015-02-12 14:49:28,914 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,915 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,915 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52795, dest: /127.0.0.1:50539, bytes: 75556, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219, duration: 7436000
2015-02-12 14:49:28,915 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,917 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,922 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:28,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:49:28,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:28,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:49:28,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:49:28,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019/job_1423780884992_0019_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:49:28,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:28,950 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:49:28,953 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220 src: /127.0.0.1:52799 dest: /127.0.0.1:50543
2015-02-12 14:49:28,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220 src: /127.0.0.1:52800 dest: /127.0.0.1:50539
2015-02-12 14:49:28,955 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220 src: /127.0.0.1:52801 dest: /127.0.0.1:50546
2015-02-12 14:49:28,960 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52801, dest: /127.0.0.1:50546, bytes: 113943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220, duration: 2588000
2015-02-12 14:49:28,960 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:28,961 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:49:28,961 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52800, dest: /127.0.0.1:50539, bytes: 113943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220, duration: 3512000
2015-02-12 14:49:28,961 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,962 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52799, dest: /127.0.0.1:50543, bytes: 113943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1187250428_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220, duration: 5009000
2015-02-12 14:49:28,963 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:28,965 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,965 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:28,967 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1187250428_1
2015-02-12 14:49:28,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:28,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:28,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:28,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:49:28,990 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0019_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:49:28,990 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:49:28,991 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0019 with final state: FINISHING
2015-02-12 14:49:28,991 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from RUNNING to FINAL_SAVING
2015-02-12 14:49:28,991 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0019
2015-02-12 14:49:28,992 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:49:28,992 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from FINAL_SAVING to FINISHING
2015-02-12 14:49:29,687 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:29,687 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 14:49:29,687 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000010
2015-02-12 14:49:29,687 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:49:29,687 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000010 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:49:29,996 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0019 unregistered successfully.
2015-02-12 14:49:30,000 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742034_1210 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:49:30,001 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742035_1211 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:49:30,001 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742036_1212 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:49:30,001 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742037_1213 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:49:30,001 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742039_1215 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:49:30,001 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742040_1216 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:49:30,002 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742038_1214 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:49:30,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0019 dst=null perm=null proto=rpc
2015-02-12 14:49:30,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,036 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary
2015-02-12 14:49:30,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/_temporary dst=null perm=null proto=rpc
2015-02-12 14:49:30,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,053 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:30,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:30,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,089 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:30,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:30,094 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/joinnone
2015-02-12 14:49:30,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone dst=null perm=null proto=rpc
2015-02-12 14:49:30,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:30,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/joinnone/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:49:30,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:30,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:30,126 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:49:30,127 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:49:30,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery"]
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 3
2015-02-12 14:49:30,169 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 3
2015-02-12 14:49:30,174 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-02-12 14:49:30,174 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-02-12 14:49:30,191 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:49:30,204 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:49:30,215 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:49:30,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:49:30,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:30,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:30,224 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 20
2015-02-12 14:49:30,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020 dst=null perm=null proto=rpc
2015-02-12 14:49:30,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:49:30,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:49:30,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,233 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:49:30,235 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:49:30,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:49:30,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:30,239 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 src: /127.0.0.1:52806 dest: /127.0.0.1:50549
2015-02-12 14:49:30,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:30,241 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 21
2015-02-12 14:49:30,241 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 src: /127.0.0.1:52807 dest: /127.0.0.1:50539
2015-02-12 14:49:30,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021 dst=null perm=null proto=rpc
2015-02-12 14:49:30,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 src: /127.0.0.1:52808 dest: /127.0.0.1:50546
2015-02-12 14:49:30,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:49:30,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:49:30,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,251 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52808, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221, duration: 4940000
2015-02-12 14:49:30,251 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,252 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,252 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52807, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221, duration: 5503000
2015-02-12 14:49:30,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,252 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,252 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,253 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52806, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221, duration: 6855000
2015-02-12 14:49:30,253 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,257 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:49:30,257 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,258 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar
2015-02-12 14:49:30,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 src: /127.0.0.1:52809 dest: /127.0.0.1:50543
2015-02-12 14:49:30,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 src: /127.0.0.1:52810 dest: /127.0.0.1:50539
2015-02-12 14:49:30,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 src: /127.0.0.1:52811 dest: /127.0.0.1:50549
2015-02-12 14:49:30,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:49:30,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:49:30,270 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52811, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222, duration: 3951000
2015-02-12 14:49:30,270 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,271 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52810, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222, duration: 5883000
2015-02-12 14:49:30,271 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:49:30,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,272 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52809, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222, duration: 7367000
2015-02-12 14:49:30,273 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,275 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,276 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:49:30,277 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:49:30,278 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar
2015-02-12 14:49:30,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:30,281 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:30,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:49:30,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:49:30,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:49:30,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:49:30,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:49:30,287 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split
2015-02-12 14:49:30,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:30,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:49:30,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,289 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:49:30,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:30,292 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223 src: /127.0.0.1:52812 dest: /127.0.0.1:50546
2015-02-12 14:49:30,292 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:49:30,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:49:30,294 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223 src: /127.0.0.1:52813 dest: /127.0.0.1:50543
2015-02-12 14:49:30,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223 src: /127.0.0.1:52814 dest: /127.0.0.1:50539
2015-02-12 14:49:30,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223 src: /127.0.0.1:52815 dest: /127.0.0.1:50549
2015-02-12 14:49:30,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,301 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split
2015-02-12 14:49:30,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:30,304 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:49:30,305 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52815, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, duration: 2499000
2015-02-12 14:49:30,305 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,306 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,306 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52814, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, duration: 2542000
2015-02-12 14:49:30,308 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,308 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224 src: /127.0.0.1:52816 dest: /127.0.0.1:50549
2015-02-12 14:49:30,309 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52813, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, duration: 5662000
2015-02-12 14:49:30,309 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,310 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52812, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, duration: 7075000
2015-02-12 14:49:30,310 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,311 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224 src: /127.0.0.1:52817 dest: /127.0.0.1:50543
2015-02-12 14:49:30,317 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224 src: /127.0.0.1:52818 dest: /127.0.0.1:50546
2015-02-12 14:49:30,320 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,321 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224 src: /127.0.0.1:52819 dest: /127.0.0.1:50539
2015-02-12 14:49:30,324 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52819, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, duration: 1521000
2015-02-12 14:49:30,324 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,324 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52818, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, duration: 1827000
2015-02-12 14:49:30,324 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,325 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52817, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, duration: 2493000
2015-02-12 14:49:30,325 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,326 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52816, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, duration: 3689000
2015-02-12 14:49:30,326 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,330 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:49:30,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,330 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,330 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,331 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,332 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:49:30,334 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225 src: /127.0.0.1:52820 dest: /127.0.0.1:50543
2015-02-12 14:49:30,334 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,336 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225 src: /127.0.0.1:52821 dest: /127.0.0.1:50546
2015-02-12 14:49:30,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225 src: /127.0.0.1:52822 dest: /127.0.0.1:50539
2015-02-12 14:49:30,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,339 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:49:30,340 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52822, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225, duration: 1218000
2015-02-12 14:49:30,340 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,341 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52821, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225, duration: 1845000
2015-02-12 14:49:30,341 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226 src: /127.0.0.1:52823 dest: /127.0.0.1:50549
2015-02-12 14:49:30,342 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52820, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225, duration: 2850000
2015-02-12 14:49:30,342 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,346 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226 src: /127.0.0.1:52824 dest: /127.0.0.1:50539
2015-02-12 14:49:30,347 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,348 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,348 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226 src: /127.0.0.1:52825 dest: /127.0.0.1:50543
2015-02-12 14:49:30,348 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,349 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:49:30,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,352 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52825, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226, duration: 1455000
2015-02-12 14:49:30,352 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,353 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52824, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226, duration: 2708000
2015-02-12 14:49:30,354 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,354 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,355 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52823, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226, duration: 4492000
2015-02-12 14:49:30,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,356 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,358 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,361 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,362 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:49:30,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,367 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:49:30,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:49:30,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227 src: /127.0.0.1:52826 dest: /127.0.0.1:50549
2015-02-12 14:49:30,371 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227 src: /127.0.0.1:52827 dest: /127.0.0.1:50546
2015-02-12 14:49:30,373 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227 src: /127.0.0.1:52828 dest: /127.0.0.1:50543
2015-02-12 14:49:30,376 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52828, dest: /127.0.0.1:50543, bytes: 96726, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227, duration: 1535000
2015-02-12 14:49:30,376 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,376 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52827, dest: /127.0.0.1:50546, bytes: 96726, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227, duration: 1931000
2015-02-12 14:49:30,377 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,377 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:49:30,377 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52826, dest: /127.0.0.1:50549, bytes: 96726, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227, duration: 2716000
2015-02-12 14:49:30,378 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,378 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:49:30,379 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:49:30,380 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,381 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0020
2015-02-12 14:49:30,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020 dst=null perm=null proto=rpc
2015-02-12 14:49:30,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:30,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:30,384 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:49:30,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228 src: /127.0.0.1:52829 dest: /127.0.0.1:50549
2015-02-12 14:49:30,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:30,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:30,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228 src: /127.0.0.1:52830 dest: /127.0.0.1:50543
2015-02-12 14:49:30,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:30,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:30,388 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228 src: /127.0.0.1:52831 dest: /127.0.0.1:50546
2015-02-12 14:49:30,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,393 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52831, dest: /127.0.0.1:50546, bytes: 96721, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228, duration: 3408000
2015-02-12 14:49:30,393 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:30,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,394 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52830, dest: /127.0.0.1:50543, bytes: 96721, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228, duration: 3502000
2015-02-12 14:49:30,394 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,395 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52829, dest: /127.0.0.1:50549, bytes: 96721, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228, duration: 4376000
2015-02-12 14:49:30,395 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:30,396 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:49:30,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:49:30,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:30,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,400 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:49:30,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,400 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0021
2015-02-12 14:49:30,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021 dst=null perm=null proto=rpc
2015-02-12 14:49:30,401 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 20 submitted by user soberoi
2015-02-12 14:49:30,401 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0020
2015-02-12 14:49:30,401 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0020
2015-02-12 14:49:30,402 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0020
2015-02-12 14:49:30,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from NEW to NEW_SAVING
2015-02-12 14:49:30,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:49:30,402 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0020 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:49:30,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from SUBMITTED to ACCEPTED
2015-02-12 14:49:30,402 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0020_000001
2015-02-12 14:49:30,402 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0020
2015-02-12 14:49:30,403 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from NEW to SUBMITTED
2015-02-12 14:49:30,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:30,403 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0020_000001 to scheduler from user: soberoi
2015-02-12 14:49:30,407 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:49:30,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:30,409 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0020/
2015-02-12 14:49:30,409 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0020
2015-02-12 14:49:30,409 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0020/
2015-02-12 14:49:30,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:30,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:30,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:30,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:30,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:30,422 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 21 submitted by user soberoi
2015-02-12 14:49:30,422 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0021
2015-02-12 14:49:30,423 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0021
2015-02-12 14:49:30,423 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0021
2015-02-12 14:49:30,423 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from NEW to NEW_SAVING
2015-02-12 14:49:30,423 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:49:30,423 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0021 from user: soberoi, in queue: default, currently num of applications: 3
2015-02-12 14:49:30,423 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from SUBMITTED to ACCEPTED
2015-02-12 14:49:30,424 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0021_000001
2015-02-12 14:49:30,424 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from NEW to SUBMITTED
2015-02-12 14:49:30,424 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0021_000001 to scheduler from user: soberoi
2015-02-12 14:49:30,424 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:49:30,424 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0021
2015-02-12 14:49:30,430 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0021/
2015-02-12 14:49:30,430 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0021
2015-02-12 14:49:30,430 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0021/
2015-02-12 14:49:30,689 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:30,692 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:30,692 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000001
2015-02-12 14:49:30,692 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:49:30,692 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0020_01_000001
2015-02-12 14:49:30,693 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:30,693 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0020_000001
2015-02-12 14:49:30,693 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0020 AttemptId: appattempt_1423780884992_0020_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0020_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:49:30,693 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:49:30,694 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:49:30,694 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0020_000001
2015-02-12 14:49:30,697 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0020_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0020_000001
2015-02-12 14:49:30,697 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0020_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:49:30,697 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0020_000001
2015-02-12 14:49:30,697 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0020_000001
2015-02-12 14:49:30,699 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:30,701 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000001 by user soberoi
2015-02-12 14:49:30,701 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0020
2015-02-12 14:49:30,701 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000001
2015-02-12 14:49:30,701 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from NEW to INITING
2015-02-12 14:49:30,701 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000001 to application application_1423780884992_0020
2015-02-12 14:49:30,701 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from INITING to RUNNING
2015-02-12 14:49:30,701 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0020_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0020_000001
2015-02-12 14:49:30,702 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:49:30,702 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:49:30,702 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:49:30,702 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:30,702 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:49:30,702 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:49:30,702 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:30,703 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0020_01_000001
2015-02-12 14:49:30,712 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0020_01_000001.tokens. Credentials list:
2015-02-12 14:49:30,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:30,924 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0020_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000001.tokens
2015-02-12 14:49:30,924 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:49:31,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:31,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:31,016 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742045_1221 to datanode(s) 127.0.0.1:50543
2015-02-12 14:49:31,017 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742046_1222 to datanode(s) 127.0.0.1:50546
2015-02-12 14:49:31,017 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213, blk_1073742038_1214, blk_1073742039_1215, blk_1073742040_1216]
2015-02-12 14:49:31,017 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213, blk_1073742040_1216]
2015-02-12 14:49:31,052 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:31,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:31,086 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:31,086 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000001
2015-02-12 14:49:31,086 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:49:31,086 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0021_01_000001
2015-02-12 14:49:31,086 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:31,087 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0021_000001
2015-02-12 14:49:31,087 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0021 AttemptId: appattempt_1423780884992_0021_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0021_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:49:31,087 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:49:31,087 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:49:31,087 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0021_000001
2015-02-12 14:49:31,088 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0021_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0021_000001
2015-02-12 14:49:31,089 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0021_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:49:31,089 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0021_000001
2015-02-12 14:49:31,089 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0021_000001
2015-02-12 14:49:31,095 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:31,099 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000001 by user soberoi
2015-02-12 14:49:31,099 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0021
2015-02-12 14:49:31,100 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000001
2015-02-12 14:49:31,101 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from NEW to INITING
2015-02-12 14:49:31,102 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0021_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0021_000001
2015-02-12 14:49:31,102 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000001 to application application_1423780884992_0021
2015-02-12 14:49:31,102 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from INITING to RUNNING
2015-02-12 14:49:31,102 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:49:31,102 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:49:31,102 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:49:31,102 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:31,103 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:49:31,103 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:49:31,103 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:31,103 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0021_01_000001
2015-02-12 14:49:31,126 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0021_01_000001.tokens. Credentials list:
2015-02-12 14:49:31,199 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0020/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:31,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:31,348 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,368 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:31,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:31,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:31,451 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,451 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:31,499 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:31,499 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:31,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0021_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000001.tokens
2015-02-12 14:49:31,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:49:31,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:31,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:31,642 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000001/default_container_executor.sh]
2015-02-12 14:49:31,684 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0021/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,694 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:31,694 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:31,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:31,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:31,763 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0021/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:31,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:31,846 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0021/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,873 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034 for deletion
2015-02-12 14:49:31,873 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035 for deletion
2015-02-12 14:49:31,873 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742036 for deletion
2015-02-12 14:49:31,874 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742037 for deletion
2015-02-12 14:49:31,874 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742040_1216 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742040 for deletion
2015-02-12 14:49:31,874 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035
2015-02-12 14:49:31,874 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034
2015-02-12 14:49:31,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742037
2015-02-12 14:49:31,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742036
2015-02-12 14:49:31,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742040_1216 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742040
2015-02-12 14:49:31,875 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 to 127.0.0.1:50546
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034 for deletion
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035 for deletion
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742036 for deletion
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742037 for deletion
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742038_1214 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742038 for deletion
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742039 for deletion
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742040_1216 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742040 for deletion
2015-02-12 14:49:31,877 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035
2015-02-12 14:49:31,877 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742037
2015-02-12 14:49:31,877 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742038_1214 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742038
2015-02-12 14:49:31,878 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742040_1216 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742040
2015-02-12 14:49:31,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034
2015-02-12 14:49:31,878 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742036
2015-02-12 14:49:31,879 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742039
2015-02-12 14:49:31,879 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:49:31,880 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 src: /127.0.0.1:52840 dest: /127.0.0.1:50546
2015-02-12 14:49:31,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:31,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222 src: /127.0.0.1:52840 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:49:31,886 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742046_1222 size 254067
2015-02-12 14:49:31,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:31,947 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:31,947 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:31,993 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:31,993 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:32,089 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:32,158 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000001/default_container_executor.sh]
2015-02-12 14:49:32,221 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 to 127.0.0.1:50543
2015-02-12 14:49:32,227 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:49:32,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 src: /127.0.0.1:52841 dest: /127.0.0.1:50543
2015-02-12 14:49:32,232 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221 src: /127.0.0.1:52841 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:49:32,233 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742045_1221 size 254067
2015-02-12 14:49:32,699 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:33,701 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:34,018 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213, blk_1073742038_1214, blk_1073742039_1215]
2015-02-12 14:49:34,018 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742034_1210, blk_1073742035_1211, blk_1073742038_1214, blk_1073742039_1215, blk_1073742040_1216]
2015-02-12 14:49:34,335 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217
2015-02-12 14:49:34,336 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218
2015-02-12 14:49:34,336 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220
2015-02-12 14:49:34,337 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219
2015-02-12 14:49:34,691 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219
2015-02-12 14:49:34,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217
2015-02-12 14:49:34,693 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220
2015-02-12 14:49:34,704 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:34,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:34,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:49:34,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:49:34,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:49:35,077 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0019_01_000001 succeeded
2015-02-12 14:49:35,077 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:49:35,077 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0019_01_000001
2015-02-12 14:49:35,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020 dst=null perm=null proto=rpc
2015-02-12 14:49:35,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:49:35,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:49:35,141 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000001
2015-02-12 14:49:35,141 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000001
2015-02-12 14:49:35,142 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000001
2015-02-12 14:49:35,142 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019/container_1423780884992_0019_01_000001
2015-02-12 14:49:35,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742040_1216
2015-02-12 14:49:35,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218
2015-02-12 14:49:35,144 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000001
2015-02-12 14:49:35,144 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0019_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:49:35,144 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0019_01_000001 from application application_1423780884992_0019
2015-02-12 14:49:35,144 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742044_1220
2015-02-12 14:49:35,144 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:35,145 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0019
2015-02-12 14:49:35,220 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034 for deletion
2015-02-12 14:49:35,220 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035 for deletion
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742038_1214 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742038 for deletion
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742039 for deletion
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742040_1216 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742040 for deletion
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742039
2015-02-12 14:49:35,221 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742038_1214 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742038
2015-02-12 14:49:35,222 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742040_1216 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742040
2015-02-12 14:49:35,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:49:35,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:49:35,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:49:35,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:49:35,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021 dst=null perm=null proto=rpc
2015-02-12 14:49:35,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:49:35,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:49:35,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034 for deletion
2015-02-12 14:49:35,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035 for deletion
2015-02-12 14:49:35,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742036 for deletion
2015-02-12 14:49:35,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742037 for deletion
2015-02-12 14:49:35,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742035
2015-02-12 14:49:35,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742034
2015-02-12 14:49:35,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742036
2015-02-12 14:49:35,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742037
2015-02-12 14:49:35,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742038_1214 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742038 for deletion
2015-02-12 14:49:35,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742039 for deletion
2015-02-12 14:49:35,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742039
2015-02-12 14:49:35,480 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742038_1214 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742038
2015-02-12 14:49:35,576 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742042_1218
2015-02-12 14:49:35,578 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221
2015-02-12 14:49:35,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:35,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:35,709 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0019_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:49:35,710 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0019_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:49:35,710 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000001
2015-02-12 14:49:35,710 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0019_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:49:35,710 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0019_000001 released container container_1423780884992_0019_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:49:35,710 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:35,710 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0019_000001
2015-02-12 14:49:35,711 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0019_000001
2015-02-12 14:49:35,712 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0019_000001 State change from FINISHING to FINISHED
2015-02-12 14:49:35,712 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0019 State change from FINISHING to FINISHED
2015-02-12 14:49:35,712 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0019_000001 is done. finalState=FINISHED
2015-02-12 14:49:35,712 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0019_000001
2015-02-12 14:49:35,712 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0019 requests cleared
2015-02-12 14:49:35,712 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0019
2015-02-12 14:49:35,712 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0019,name=[6041344F38564BC7B8297E587F5661E3/F1B352A7ACAB4D78AC4AF978EDF8FE93] lower*upper/(1/1) ...dedpipesplatform/joinnone,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0019/jobhistory/job/job_1423780884992_0019,appMasterHost=10.1.1.67,startTime=1423781344333,finishTime=1423781368991,finalStatus=SUCCEEDED
2015-02-12 14:49:35,715 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0019_000001 (auth:SIMPLE)
2015-02-12 14:49:35,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0019_01_000001
2015-02-12 14:49:35,718 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0019 CONTAINERID=container_1423780884992_0019_01_000001
2015-02-12 14:49:35,720 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0019_01_000001]
2015-02-12 14:49:35,720 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:35,720 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:35,720 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:35,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:35,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:35,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:35,721 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0019
2015-02-12 14:49:35,721 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:35,722 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0019, with delay of 10800 seconds
2015-02-12 14:49:35,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:35,779 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227
2015-02-12 14:49:35,781 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742043_1219
2015-02-12 14:49:35,782 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226
2015-02-12 14:49:35,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:35,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:49:35,980 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228
2015-02-12 14:49:35,980 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223
2015-02-12 14:49:35,981 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742041_1217
2015-02-12 14:49:36,096 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:36,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,097 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0019
2015-02-12 14:49:36,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,097 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:36,097 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0019, with delay of 10800 seconds
2015-02-12 14:49:36,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,179 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222
2015-02-12 14:49:36,180 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224
2015-02-12 14:49:36,241 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:36,241 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,242 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,242 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0019
2015-02-12 14:49:36,242 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:36,242 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0019, with delay of 10800 seconds
2015-02-12 14:49:36,242 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,242 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,330 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:49:36,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,332 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0019
2015-02-12 14:49:36,332 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:49:36,332 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0019, with delay of 10800 seconds
2015-02-12 14:49:36,332 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,332 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0019
2015-02-12 14:49:36,726 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:49:37,374 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:37,378 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0020_000001
2015-02-12 14:49:37,378 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0020 APPATTEMPTID=appattempt_1423780884992_0020_000001
2015-02-12 14:49:37,378 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:49:37,378 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from ACCEPTED to RUNNING
2015-02-12 14:49:37,475 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 1805 Total time for transactions(ms): 159 Number of transactions batched in Syncs: 7 Number of syncs: 1243 SyncTimes(ms): 406 315
2015-02-12 14:49:37,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:37,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:49:37,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:37,934 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:49:37,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229 src: /127.0.0.1:52874 dest: /127.0.0.1:50549
2015-02-12 14:49:37,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229 src: /127.0.0.1:52875 dest: /127.0.0.1:50546
2015-02-12 14:49:37,996 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229 src: /127.0.0.1:52876 dest: /127.0.0.1:50543
2015-02-12 14:49:38,143 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52876, dest: /127.0.0.1:50543, bytes: 113555, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229, duration: 144939000
2015-02-12 14:49:38,143 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:38,144 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,144 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52875, dest: /127.0.0.1:50546, bytes: 113555, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229, duration: 145573000
2015-02-12 14:49:38,144 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,145 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52874, dest: /127.0.0.1:50549, bytes: 113555, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229, duration: 146589000
2015-02-12 14:49:38,145 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,152 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:49:38,186 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:38,193 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0021_000001
2015-02-12 14:49:38,193 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0021 APPATTEMPTID=appattempt_1423780884992_0021_000001
2015-02-12 14:49:38,193 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:49:38,193 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from ACCEPTED to RUNNING
2015-02-12 14:49:38,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:38,226 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:49:38,231 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230 src: /127.0.0.1:52880 dest: /127.0.0.1:50543
2015-02-12 14:49:38,233 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230 src: /127.0.0.1:52881 dest: /127.0.0.1:50549
2015-02-12 14:49:38,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230 src: /127.0.0.1:52882 dest: /127.0.0.1:50546
2015-02-12 14:49:38,253 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52882, dest: /127.0.0.1:50546, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230, duration: 14946000
2015-02-12 14:49:38,253 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:38,253 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:49:38,254 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52881, dest: /127.0.0.1:50549, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230, duration: 15587000
2015-02-12 14:49:38,254 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,255 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52880, dest: /127.0.0.1:50543, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230, duration: 16929000
2015-02-12 14:49:38,256 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,263 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020.summary is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:49:38,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:38,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:49:38,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:38,731 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:38,731 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000002
2015-02-12 14:49:38,731 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:49:38,744 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:49:38,795 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231 src: /127.0.0.1:52883 dest: /127.0.0.1:50539
2015-02-12 14:49:38,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231 src: /127.0.0.1:52884 dest: /127.0.0.1:50543
2015-02-12 14:49:38,799 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231 src: /127.0.0.1:52885 dest: /127.0.0.1:50546
2015-02-12 14:49:38,843 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52885, dest: /127.0.0.1:50546, bytes: 113550, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231, duration: 40632000
2015-02-12 14:49:38,843 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:38,844 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:49:38,844 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52884, dest: /127.0.0.1:50543, bytes: 113550, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231, duration: 41202000
2015-02-12 14:49:38,844 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,845 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52883, dest: /127.0.0.1:50539, bytes: 113550, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231, duration: 42818000
2015-02-12 14:49:38,846 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,849 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,857 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:49:38,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:49:38,899 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:49:38,903 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232 src: /127.0.0.1:52886 dest: /127.0.0.1:50549
2015-02-12 14:49:38,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232 src: /127.0.0.1:52887 dest: /127.0.0.1:50543
2015-02-12 14:49:38,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232 src: /127.0.0.1:52888 dest: /127.0.0.1:50539
2015-02-12 14:49:38,910 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52888, dest: /127.0.0.1:50539, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232, duration: 1437000
2015-02-12 14:49:38,910 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:49:38,910 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,911 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52887, dest: /127.0.0.1:50543, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232, duration: 2291000
2015-02-12 14:49:38,911 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,911 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52886, dest: /127.0.0.1:50549, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232, duration: 3079000
2015-02-12 14:49:38,912 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:49:38,912 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:49:38,914 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021.summary is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:49:39,104 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:39,104 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000003
2015-02-12 14:49:39,104 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:49:39,254 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:39,254 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000004
2015-02-12 14:49:39,254 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:49:39,341 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227
2015-02-12 14:49:39,341 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223
2015-02-12 14:49:39,342 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:39,342 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000002
2015-02-12 14:49:39,342 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:49:39,343 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221
2015-02-12 14:49:39,343 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226
2015-02-12 14:49:39,344 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225
2015-02-12 14:49:39,344 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224
2015-02-12 14:49:39,511 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0020_01_000002
2015-02-12 14:49:39,511 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:39,511 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0020_01_000003
2015-02-12 14:49:39,512 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:39,512 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0020_01_000004
2015-02-12 14:49:39,512 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:39,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:39,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:39,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,570 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30002 milliseconds
2015-02-12 14:49:39,570 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:49:39,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:39,656 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:39,656 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:39,656 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:39,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000004 by user soberoi
2015-02-12 14:49:39,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000002 by user soberoi
2015-02-12 14:49:39,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0020
2015-02-12 14:49:39,659 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000002
2015-02-12 14:49:39,659 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000002 to application application_1423780884992_0020
2015-02-12 14:49:39,659 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from NEW to INITING
2015-02-12 14:49:39,660 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000004 to application application_1423780884992_0020
2015-02-12 14:49:39,660 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from INITING to RUNNING
2015-02-12 14:49:39,660 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:49:39,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000003 by user soberoi
2015-02-12 14:49:39,660 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0020
2015-02-12 14:49:39,661 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000003
2015-02-12 14:49:39,660 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:49:39,661 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0020
2015-02-12 14:49:39,661 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:39,661 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0020
2015-02-12 14:49:39,661 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:39,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:39,660 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:49:39,662 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:49:39,662 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0020
2015-02-12 14:49:39,662 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:39,662 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0020
2015-02-12 14:49:39,659 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000004
2015-02-12 14:49:39,663 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:39,662 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0020_01_000004
2015-02-12 14:49:39,661 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from NEW to INITING
2015-02-12 14:49:39,664 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000003 to application application_1423780884992_0020
2015-02-12 14:49:39,664 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from INITING to RUNNING
2015-02-12 14:49:39,664 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:49:39,664 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:49:39,664 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0020
2015-02-12 14:49:39,664 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:39,664 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0020
2015-02-12 14:49:39,665 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:39,665 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:39,665 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0020_01_000003
2015-02-12 14:49:39,694 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0020_01_000003.tokens. Credentials list:
2015-02-12 14:49:39,698 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0020_01_000004.tokens. Credentials list:
2015-02-12 14:49:39,699 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221
2015-02-12 14:49:39,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225
2015-02-12 14:49:39,728 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:39,728 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:39,732 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:39,732 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:39,732 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000003
2015-02-12 14:49:39,733 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:49:39,743 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222
2015-02-12 14:49:39,744 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228
2015-02-12 14:49:39,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:39,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:39,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000002/default_container_executor.sh]
2015-02-12 14:49:40,098 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222
2015-02-12 14:49:40,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742050_1226
2015-02-12 14:49:40,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224
2015-02-12 14:49:40,100 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223
2015-02-12 14:49:40,104 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:40,105 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:40,105 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000004
2015-02-12 14:49:40,105 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:49:40,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0020_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000004.tokens
2015-02-12 14:49:40,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:49:40,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0020_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000003.tokens
2015-02-12 14:49:40,122 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:49:40,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742052_1228
2015-02-12 14:49:40,150 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742045_1221
2015-02-12 14:49:40,150 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742049_1225
2015-02-12 14:49:40,254 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:40,255 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:40,255 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000005
2015-02-12 14:49:40,255 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:49:40,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,345 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:40,345 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000005
2015-02-12 14:49:40,345 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:49:40,347 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0021_01_000002
2015-02-12 14:49:40,347 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:40,348 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0021_01_000003
2015-02-12 14:49:40,348 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:40,348 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0021_01_000004
2015-02-12 14:49:40,348 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:40,349 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:40,350 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742051_1227
2015-02-12 14:49:40,351 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742047_1223
2015-02-12 14:49:40,354 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:40,379 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0020/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:40,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:40,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:40,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:40,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:40,472 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0020/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:40,472 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:40,480 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0020/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:40,480 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:40,523 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:40,531 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:40,531 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:40,533 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:40,536 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000005 by user soberoi
2015-02-12 14:49:40,537 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000005
2015-02-12 14:49:40,537 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000005 to application application_1423780884992_0020
2015-02-12 14:49:40,537 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:49:40,537 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:49:40,537 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0020
2015-02-12 14:49:40,537 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:40,537 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0020
2015-02-12 14:49:40,538 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:40,551 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742046_1222
2015-02-12 14:49:40,552 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742048_1224
2015-02-12 14:49:40,554 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:40,554 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:40,605 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:40,606 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:40,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:40,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:40,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:49:40,735 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0020
2015-02-12 14:49:40,736 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000006 Container Transitioned from NEW to RESERVED
2015-02-12 14:49:40,736 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0020_01_000006 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@4f1e7ad
2015-02-12 14:49:40,747 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000004/default_container_executor.sh]
2015-02-12 14:49:40,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000003/default_container_executor.sh]
2015-02-12 14:49:40,801 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000005/default_container_executor.sh]
2015-02-12 14:49:40,914 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:40,914 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:40,915 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:40,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000002 by user soberoi
2015-02-12 14:49:40,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0021
2015-02-12 14:49:40,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000004 by user soberoi
2015-02-12 14:49:40,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000003 by user soberoi
2015-02-12 14:49:40,919 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from NEW to INITING
2015-02-12 14:49:40,919 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000004
2015-02-12 14:49:40,918 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000002
2015-02-12 14:49:40,919 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000002 to application application_1423780884992_0021
2015-02-12 14:49:40,919 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0021
2015-02-12 14:49:40,919 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from INITING to RUNNING
2015-02-12 14:49:40,919 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000003
2015-02-12 14:49:40,919 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:49:40,919 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,920 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,920 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:40,920 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0021
2015-02-12 14:49:40,919 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000004 to application application_1423780884992_0021
2015-02-12 14:49:40,920 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:40,920 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:40,920 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from NEW to INITING
2015-02-12 14:49:40,920 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000003 to application application_1423780884992_0021
2015-02-12 14:49:40,920 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:49:40,920 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from INITING to RUNNING
2015-02-12 14:49:40,920 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0021_01_000002
2015-02-12 14:49:40,921 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:49:40,920 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,921 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,921 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:40,921 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,921 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,921 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:40,921 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0021
2015-02-12 14:49:40,921 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0021
2015-02-12 14:49:40,921 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:49:40,921 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:49:40,921 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:40,922 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0021_01_000003
2015-02-12 14:49:40,927 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:40,931 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000005 by user soberoi
2015-02-12 14:49:40,931 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000005
2015-02-12 14:49:40,932 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000005 to application application_1423780884992_0021
2015-02-12 14:49:40,932 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:49:40,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0021
2015-02-12 14:49:40,932 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:40,932 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0021
2015-02-12 14:49:40,933 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0021_01_000005
2015-02-12 14:49:40,942 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0021_01_000002.tokens. Credentials list:
2015-02-12 14:49:40,943 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0021_01_000003.tokens. Credentials list:
2015-02-12 14:49:40,950 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0021_01_000005.tokens. Credentials list:
2015-02-12 14:49:40,987 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:40,987 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:41,105 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:41,106 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0020
2015-02-12 14:49:41,106 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:49:41,106 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0020_01_000007 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@4f1e7ad
2015-02-12 14:49:41,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:41,189 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:41,256 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:41,256 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:41,256 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000008
2015-02-12 14:49:41,256 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:49:41,266 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000004/default_container_executor.sh]
2015-02-12 14:49:41,347 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:41,347 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:41,348 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:41,348 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000006
2015-02-12 14:49:41,348 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:49:41,378 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0021_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000003.tokens
2015-02-12 14:49:41,379 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:49:41,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:41,391 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:49:41,394 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000006 by user soberoi
2015-02-12 14:49:41,394 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000006
2015-02-12 14:49:41,394 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000006 to application application_1423780884992_0021
2015-02-12 14:49:41,395 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:49:41,395 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:49:41,395 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0021
2015-02-12 14:49:41,395 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:41,395 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0021
2015-02-12 14:49:41,395 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0021_01_000006
2015-02-12 14:49:41,415 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0021_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000002.tokens
2015-02-12 14:49:41,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:49:41,430 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0021_01_000006.tokens. Credentials list:
2015-02-12 14:49:41,537 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:41,545 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:49:41,548 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000008 by user soberoi
2015-02-12 14:49:41,548 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000008
2015-02-12 14:49:41,548 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000008 to application application_1423780884992_0020
2015-02-12 14:49:41,548 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:49:41,549 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:49:41,549 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0020
2015-02-12 14:49:41,549 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:49:41,549 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0020
2015-02-12 14:49:41,549 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:41,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:41,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:41,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:41,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar dst=null perm=null proto=rpc
2015-02-12 14:49:41,617 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:41,617 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:41,657 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:41,674 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0021/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:41,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:41,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:41,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:41,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml dst=null perm=null proto=rpc
2015-02-12 14:49:41,741 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:41,741 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0020_000001 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096
2015-02-12 14:49:41,741 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0020 unreserved on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 14:49:41,741 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0020
2015-02-12 14:49:41,741 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000009 Container Transitioned from NEW to RESERVED
2015-02-12 14:49:41,742 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0020_01_000009 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@4f1e7ad
2015-02-12 14:49:41,791 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:41,792 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:41,816 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0021/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:49:41,816 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:41,816 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:41,816 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:49:41,895 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:41,895 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:41,905 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:41,905 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:41,914 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:41,915 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:49:41,915 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:41,915 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:49:41,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000008/default_container_executor.sh]
2015-02-12 14:49:42,108 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0020_000001 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096
2015-02-12 14:49:42,108 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0020 unreserved on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 14:49:42,109 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0020
2015-02-12 14:49:42,109 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000010 Container Transitioned from NEW to RESERVED
2015-02-12 14:49:42,109 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0020_01_000010 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@4f1e7ad
2015-02-12 14:49:42,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000003/default_container_executor.sh]
2015-02-12 14:49:42,235 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000006/default_container_executor.sh]
2015-02-12 14:49:42,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000002/default_container_executor.sh]
2015-02-12 14:49:42,258 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:42,259 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:42,259 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000011
2015-02-12 14:49:42,259 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 14:49:42,261 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000005/default_container_executor.sh]
2015-02-12 14:49:42,350 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:49:42,351 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:49:42,351 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000007
2015-02-12 14:49:42,351 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 14:49:42,387 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:49:42,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:42,544 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:49:42,545 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:49:42,743 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0020_000001 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096
2015-02-12 14:49:42,743 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0020 unreserved on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 14:49:42,846 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:43,000 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0021_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000006.tokens
2015-02-12 14:49:43,001 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:49:43,109 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0020_000001 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096
2015-02-12 14:49:43,109 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0020 unreserved on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:49:43,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:49:43,269 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0021_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000005.tokens
2015-02-12 14:49:43,269 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:49:43,391 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:49:43,391 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:49:43,391 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000007
2015-02-12 14:49:43,392 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 14:49:43,392 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000007 on node: host: 10.1.1.67:50583 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 14:49:43,550 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000011 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:49:43,551 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000011 in state: RELEASED event:RELEASED
2015-02-12 14:49:43,551 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000011
2015-02-12 14:49:43,551 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 14:49:43,551 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000011 on node: host: 10.1.1.67:50579 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 14:49:44,264 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0020_01_000011
2015-02-12 14:49:44,354 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0021_01_000007
2015-02-12 14:49:44,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229
2015-02-12 14:49:44,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230
2015-02-12 14:49:44,754 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231
2015-02-12 14:49:44,754 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232
2015-02-12 14:49:45,107 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231
2015-02-12 14:49:45,108 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232
2015-02-12 14:49:45,560 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742055_1231
2015-02-12 14:49:45,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229
2015-02-12 14:49:45,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230
2015-02-12 14:49:46,192 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742056_1232
2015-02-12 14:49:46,193 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742053_1229
2015-02-12 14:49:46,193 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742054_1230
2015-02-12 14:49:59,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:59,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:49:59,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:00,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:00,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:50:01,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:50:02,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:02,041 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:02,043 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000002
2015-02-12 14:50:02,044 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000002
2015-02-12 14:50:02,044 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:50:02,044 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000002
2015-02-12 14:50:02,061 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:50:02,064 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233 src: /127.0.0.1:52972 dest: /127.0.0.1:50543
2015-02-12 14:50:02,065 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0020_01_000002 is : 143
2015-02-12 14:50:02,066 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233 src: /127.0.0.1:52973 dest: /127.0.0.1:50546
2015-02-12 14:50:02,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233 src: /127.0.0.1:52974 dest: /127.0.0.1:50549
2015-02-12 14:50:02,073 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist for DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:02,078 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:02,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000002
2015-02-12 14:50:02,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000002
2015-02-12 14:50:02,079 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000002
2015-02-12 14:50:02,079 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000002
2015-02-12 14:50:02,082 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000002
2015-02-12 14:50:02,082 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:02,082 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000002 from application application_1423780884992_0020
2015-02-12 14:50:02,082 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:02,082 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:02,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:50:02,413 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:02,415 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000003
2015-02-12 14:50:02,415 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000003
2015-02-12 14:50:02,415 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:50:02,415 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000003
2015-02-12 14:50:02,432 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0020_01_000003 is : 143
2015-02-12 14:50:02,443 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:02,443 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000003
2015-02-12 14:50:02,444 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000003
2015-02-12 14:50:02,444 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000003
2015-02-12 14:50:02,445 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000003
2015-02-12 14:50:02,447 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000003
2015-02-12 14:50:02,448 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:02,448 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000003 from application application_1423780884992_0020
2015-02-12 14:50:02,448 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:02,448 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:02,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:50:02,546 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:02,548 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000004
2015-02-12 14:50:02,549 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000004
2015-02-12 14:50:02,549 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:50:02,549 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000004
2015-02-12 14:50:02,567 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0020_01_000004 is : 143
2015-02-12 14:50:02,576 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:02,577 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000004
2015-02-12 14:50:02,577 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000004
2015-02-12 14:50:02,578 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000004
2015-02-12 14:50:02,578 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000004
2015-02-12 14:50:02,578 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000004
2015-02-12 14:50:02,578 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:02,578 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000004 from application application_1423780884992_0020
2015-02-12 14:50:02,579 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:02,579 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:02,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:50:02,735 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:02,738 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000005
2015-02-12 14:50:02,738 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000005
2015-02-12 14:50:02,739 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:02,739 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:50:02,739 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000004
2015-02-12 14:50:02,739 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:50:02,739 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000004 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:02,739 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:50:02,740 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000005
2015-02-12 14:50:02,775 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0020_01_000005 is : 143
2015-02-12 14:50:02,794 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:02,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000005
2015-02-12 14:50:02,796 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000005
2015-02-12 14:50:02,801 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000005
2015-02-12 14:50:02,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000005
2015-02-12 14:50:02,803 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000005
2015-02-12 14:50:02,804 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:02,804 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000005 from application application_1423780884992_0020
2015-02-12 14:50:02,804 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:02,805 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:02,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:50:02,879 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:02,881 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000003
2015-02-12 14:50:02,881 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000003
2015-02-12 14:50:02,881 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:50:02,881 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000003
2015-02-12 14:50:02,882 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:02,882 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:50:02,882 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000002
2015-02-12 14:50:02,882 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:50:02,882 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000002 on node: host: 10.1.1.67:50575 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:50:02,908 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0021_01_000003 is : 143
2015-02-12 14:50:02,910 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:50:02,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234 src: /127.0.0.1:52985 dest: /127.0.0.1:50539
2015-02-12 14:50:02,915 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234 src: /127.0.0.1:52986 dest: /127.0.0.1:50546
2015-02-12 14:50:02,916 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234 src: /127.0.0.1:52987 dest: /127.0.0.1:50543
2015-02-12 14:50:02,919 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:02,919 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000003
2015-02-12 14:50:02,920 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000003
2015-02-12 14:50:02,920 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000003
2015-02-12 14:50:02,920 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000003
2015-02-12 14:50:02,920 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:02,920 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000003 from application application_1423780884992_0021
2015-02-12 14:50:02,920 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:02,920 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:02,921 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000003
2015-02-12 14:50:02,921 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist for DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:02,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:50:03,012 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:03,014 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000004
2015-02-12 14:50:03,014 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000004
2015-02-12 14:50:03,014 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:50:03,015 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000004
2015-02-12 14:50:03,016 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:03,016 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:50:03,016 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000003
2015-02-12 14:50:03,016 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:50:03,016 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000003 on node: host: 10.1.1.67:50571 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:50:03,038 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0021_01_000004 is : 143
2015-02-12 14:50:03,052 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:03,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000004
2015-02-12 14:50:03,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000004
2015-02-12 14:50:03,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000004
2015-02-12 14:50:03,060 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000004
2015-02-12 14:50:03,061 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000004
2015-02-12 14:50:03,062 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:03,063 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000004 from application application_1423780884992_0021
2015-02-12 14:50:03,063 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:03,063 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:03,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:03,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:50:03,170 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:03,172 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000002
2015-02-12 14:50:03,172 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000002
2015-02-12 14:50:03,172 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:50:03,172 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000002
2015-02-12 14:50:03,193 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0021_01_000002 is : 143
2015-02-12 14:50:03,206 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:03,207 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:03,208 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000008
2015-02-12 14:50:03,208 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000008
2015-02-12 14:50:03,208 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000002
2015-02-12 14:50:03,209 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000002
2015-02-12 14:50:03,209 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:03,209 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000002 from application application_1423780884992_0021
2015-02-12 14:50:03,209 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:03,209 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:03,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000002
2015-02-12 14:50:03,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000002
2015-02-12 14:50:03,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000002
2015-02-12 14:50:03,211 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:03,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:03,211 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:50:03,211 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000005
2015-02-12 14:50:03,211 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:50:03,211 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000005 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:50:03,212 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:50:03,212 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000008
2015-02-12 14:50:03,234 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0020_01_000008 is : 143
2015-02-12 14:50:03,251 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:03,252 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000008
2015-02-12 14:50:03,253 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000008
2015-02-12 14:50:03,254 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000008
2015-02-12 14:50:03,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000008
2015-02-12 14:50:03,256 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000008
2015-02-12 14:50:03,256 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:03,257 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000008 from application application_1423780884992_0020
2015-02-12 14:50:03,257 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:03,258 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:03,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:50:03,304 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:03,308 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000005
2015-02-12 14:50:03,308 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000005
2015-02-12 14:50:03,308 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:50:03,309 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000005
2015-02-12 14:50:03,309 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:03,309 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:50:03,309 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000002
2015-02-12 14:50:03,309 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:50:03,309 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000002 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:03,337 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0021_01_000005 is : 143
2015-02-12 14:50:03,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:50:03,351 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:03,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000005
2015-02-12 14:50:03,354 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000005
2015-02-12 14:50:03,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000005
2015-02-12 14:50:03,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000005
2015-02-12 14:50:03,356 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000005
2015-02-12 14:50:03,356 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:03,358 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000005 from application application_1423780884992_0021
2015-02-12 14:50:03,359 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:03,359 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:03,382 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:03,384 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000006
2015-02-12 14:50:03,385 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000006
2015-02-12 14:50:03,385 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:03,385 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:50:03,386 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000006
2015-02-12 14:50:03,386 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:03,387 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:50:03,387 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000005
2015-02-12 14:50:03,387 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:50:03,387 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000005 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:50:03,406 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0021_01_000006 is : 143
2015-02-12 14:50:03,418 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:03,418 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000006
2015-02-12 14:50:03,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000006
2015-02-12 14:50:03,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000006
2015-02-12 14:50:03,420 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000006
2015-02-12 14:50:03,420 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000006
2015-02-12 14:50:03,421 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:03,421 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000006 from application application_1423780884992_0021
2015-02-12 14:50:03,421 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:03,421 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:03,883 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:03,883 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:03,883 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:50:03,883 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000003
2015-02-12 14:50:03,884 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:03,884 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000003 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:03,884 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000012 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:03,884 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000012
2015-02-12 14:50:03,885 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0020_01_000012 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:50:04,019 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,019 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:04,019 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:50:04,019 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000004
2015-02-12 14:50:04,020 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:04,020 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000004 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:04,214 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,214 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,214 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:04,214 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:50:04,214 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000008
2015-02-12 14:50:04,215 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:04,215 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000008 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:04,388 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,388 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:04,389 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:50:04,389 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000006
2015-02-12 14:50:04,389 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:04,389 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000006 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:04,632 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000012 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:04,644 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:04,646 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0020_01_000012 by user soberoi
2015-02-12 14:50:04,646 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000012
2015-02-12 14:50:04,646 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0020_01_000012 to application application_1423780884992_0020
2015-02-12 14:50:04,646 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000012 transitioned from NEW to LOCALIZING
2015-02-12 14:50:04,646 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0020
2015-02-12 14:50:04,647 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0020
2015-02-12 14:50:04,647 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:04,647 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0020
2015-02-12 14:50:04,648 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000012 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:04,680 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000012 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:04,680 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:04,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000012/default_container_executor.sh]
2015-02-12 14:50:04,885 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0020_01_000002]
2015-02-12 14:50:04,885 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000012 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:04,885 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,885 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:04,885 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:04,886 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000008
2015-02-12 14:50:04,886 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0021_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:50:05,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0020_01_000003]
2015-02-12 14:50:05,022 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,022 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,218 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0020_01_000005, container_1423780884992_0020_01_000004]
2015-02-12 14:50:05,218 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,218 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,219 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0021_01_000002, container_1423780884992_0021_01_000005]
2015-02-12 14:50:05,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:05,482 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:05,517 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:05,519 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0021_01_000008 by user soberoi
2015-02-12 14:50:05,520 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000008
2015-02-12 14:50:05,520 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0021_01_000008 to application application_1423780884992_0021
2015-02-12 14:50:05,520 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:50:05,520 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0021
2015-02-12 14:50:05,520 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0021
2015-02-12 14:50:05,520 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:05,521 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0021
2015-02-12 14:50:05,521 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:05,562 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:05,562 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:05,640 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:50:05,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000008/default_container_executor.sh]
2015-02-12 14:50:05,888 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0021_01_000003]
2015-02-12 14:50:05,889 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:05,889 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:06,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0021_01_000004]
2015-02-12 14:50:06,023 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:06,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0020_01_000008]
2015-02-12 14:50:06,220 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:06,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0021_01_000006]
2015-02-12 14:50:06,392 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:06,485 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:50:09,186 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:09,190 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:09,193 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:09,575 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:50:09,575 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:50:09,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:09,689 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:50:09,821 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235 src: /127.0.0.1:53006 dest: /127.0.0.1:50543
2015-02-12 14:50:09,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235 src: /127.0.0.1:53007 dest: /127.0.0.1:50549
2015-02-12 14:50:09,824 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235 src: /127.0.0.1:53008 dest: /127.0.0.1:50546
2015-02-12 14:50:09,873 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53008, dest: /127.0.0.1:50546, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0020_r_000000_0_-2078072995_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235, duration: 47403000
2015-02-12 14:50:09,873 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:09,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:50:09,874 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53007, dest: /127.0.0.1:50549, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0020_r_000000_0_-2078072995_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235, duration: 48307000
2015-02-12 14:50:09,875 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:09,877 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53006, dest: /127.0.0.1:50543, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0020_r_000000_0_-2078072995_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235, duration: 50830000
2015-02-12 14:50:09,877 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:09,878 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:09,878 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:09,890 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0020_r_000000_0_-2078072995_1
2015-02-12 14:50:09,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:09,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:09,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/task_1423780884992_0020_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:09,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/_temporary/attempt_1423780884992_0020_r_000000_0 dst=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/task_1423780884992_0020_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:50:09,944 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:09,947 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000012
2015-02-12 14:50:09,948 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000012
2015-02-12 14:50:09,948 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000012 transitioned from RUNNING to KILLING
2015-02-12 14:50:09,948 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000012
2015-02-12 14:50:09,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:09,962 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:09,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:50:09,980 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0020_01_000012 is : 143
2015-02-12 14:50:09,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:09,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:09,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/task_1423780884992_0020_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:09,989 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000012 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:09,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000012
2015-02-12 14:50:09,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000012
2015-02-12 14:50:09,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:09,990 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000012
2015-02-12 14:50:09,991 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000012 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:09,991 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000012 from application application_1423780884992_0020
2015-02-12 14:50:09,991 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:09,991 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:09,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000012
2015-02-12 14:50:09,991 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000012
2015-02-12 14:50:09,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary/1/task_1423780884992_0020_r_000000/part-00000 dst=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_temporary dst=null perm=null proto=rpc
2015-02-12 14:50:10,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,013 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:10,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,017 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:10,036 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52974, dest: /127.0.0.1:50549, bytes: 68398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233, duration: 7967026000
2015-02-12 14:50:10,036 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:10,037 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16338
2015-02-12 14:50:10,038 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52973, dest: /127.0.0.1:50546, bytes: 68398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233, duration: 7968623000
2015-02-12 14:50:10,038 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16338
2015-02-12 14:50:10,039 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52972, dest: /127.0.0.1:50543, bytes: 68398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233, duration: 7970255000
2015-02-12 14:50:10,039 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742057_1233, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 16338
2015-02-12 14:50:10,041 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:10,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,050 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:50:10,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236 src: /127.0.0.1:53010 dest: /127.0.0.1:50543
2015-02-12 14:50:10,058 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236 src: /127.0.0.1:53011 dest: /127.0.0.1:50549
2015-02-12 14:50:10,061 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236 src: /127.0.0.1:53012 dest: /127.0.0.1:50546
2015-02-12 14:50:10,067 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53012, dest: /127.0.0.1:50546, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236, duration: 2061000
2015-02-12 14:50:10,069 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:10,072 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,072 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53011, dest: /127.0.0.1:50549, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236, duration: 7473000
2015-02-12 14:50:10,073 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,075 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53010, dest: /127.0.0.1:50543, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236, duration: 11642000
2015-02-12 14:50:10,075 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,077 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,077 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,080 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:10,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:10,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:10,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:10,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:10,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:10,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:10,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,113 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:50:10,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237 src: /127.0.0.1:53014 dest: /127.0.0.1:50543
2015-02-12 14:50:10,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237 src: /127.0.0.1:53015 dest: /127.0.0.1:50546
2015-02-12 14:50:10,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237 src: /127.0.0.1:53016 dest: /127.0.0.1:50539
2015-02-12 14:50:10,122 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53016, dest: /127.0.0.1:50539, bytes: 68398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237, duration: 2300000
2015-02-12 14:50:10,123 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:10,123 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:50:10,124 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53015, dest: /127.0.0.1:50546, bytes: 68398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237, duration: 3037000
2015-02-12 14:50:10,124 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,125 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53014, dest: /127.0.0.1:50543, bytes: 68398, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237, duration: 4814000
2015-02-12 14:50:10,126 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,129 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,129 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,141 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:10,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:10,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:10,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:10,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:10,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:10,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020/job_1423780884992_0020_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:10,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,178 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:10,181 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238 src: /127.0.0.1:53018 dest: /127.0.0.1:50539
2015-02-12 14:50:10,183 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238 src: /127.0.0.1:53019 dest: /127.0.0.1:50543
2015-02-12 14:50:10,185 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238 src: /127.0.0.1:53020 dest: /127.0.0.1:50549
2015-02-12 14:50:10,189 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53020, dest: /127.0.0.1:50549, bytes: 113555, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238, duration: 2839000
2015-02-12 14:50:10,189 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:10,190 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,190 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53019, dest: /127.0.0.1:50543, bytes: 113555, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238, duration: 3600000
2015-02-12 14:50:10,190 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,191 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,191 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53018, dest: /127.0.0.1:50539, bytes: 113555, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1376876159_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238, duration: 4379000
2015-02-12 14:50:10,191 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:10,192 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:10,194 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1376876159_1
2015-02-12 14:50:10,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:10,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:10,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:10,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:10,209 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0020_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:50:10,209 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:10,209 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0020 with final state: FINISHING
2015-02-12 14:50:10,210 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:10,210 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0020
2015-02-12 14:50:10,213 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:10,213 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:10,586 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:10,589 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:10,594 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:10,609 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:10,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:10,903 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:50:10,952 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000012 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:10,952 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000012 in state: COMPLETED event:FINISHED
2015-02-12 14:50:10,952 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000012
2015-02-12 14:50:10,952 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000012 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:50:10,952 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000012 on node: host: 10.1.1.67:50575 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:50:11,030 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239 src: /127.0.0.1:53026 dest: /127.0.0.1:50543
2015-02-12 14:50:11,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239 src: /127.0.0.1:53027 dest: /127.0.0.1:50546
2015-02-12 14:50:11,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239 src: /127.0.0.1:53028 dest: /127.0.0.1:50539
2015-02-12 14:50:11,093 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53028, dest: /127.0.0.1:50539, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0021_r_000000_0_-1058909662_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239, duration: 57814000
2015-02-12 14:50:11,094 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:11,096 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53027, dest: /127.0.0.1:50546, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0021_r_000000_0_-1058909662_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239, duration: 61437000
2015-02-12 14:50:11,097 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,101 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53026, dest: /127.0.0.1:50543, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0021_r_000000_0_-1058909662_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239, duration: 65929000
2015-02-12 14:50:11,101 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,102 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:50:11,103 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,111 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0021_r_000000_0_-1058909662_1
2015-02-12 14:50:11,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:11,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:11,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/task_1423780884992_0021_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:11,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/_temporary/attempt_1423780884992_0021_r_000000_0 dst=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/task_1423780884992_0021_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:50:11,155 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:11,157 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000008
2015-02-12 14:50:11,158 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000008
2015-02-12 14:50:11,158 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:50:11,158 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000008
2015-02-12 14:50:11,159 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:11,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,175 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:50:11,185 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0021_01_000008 is : 143
2015-02-12 14:50:11,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:11,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:11,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/task_1423780884992_0021_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:11,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:11,210 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:11,211 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000008
2015-02-12 14:50:11,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000008
2015-02-12 14:50:11,211 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:11,211 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000008 from application application_1423780884992_0021
2015-02-12 14:50:11,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000008
2015-02-12 14:50:11,211 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:11,212 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:11,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000008
2015-02-12 14:50:11,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000008
2015-02-12 14:50:11,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary/1/task_1423780884992_0021_r_000000/part-00000 dst=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,215 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0020 unregistered successfully.
2015-02-12 14:50:11,219 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742045_1221 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:50:11,219 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742047_1223 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:50:11,219 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742049_1225 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:50:11,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_temporary dst=null perm=null proto=rpc
2015-02-12 14:50:11,220 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742051_1227 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:50:11,220 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742054_1230 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:50:11,220 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742057_1233 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:50:11,220 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742053_1229 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:50:11,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0020 dst=null perm=null proto=rpc
2015-02-12 14:50:11,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,230 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,238 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,269 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52987, dest: /127.0.0.1:50543, bytes: 68410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234, duration: 8351042000
2015-02-12 14:50:11,269 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:11,271 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16349
2015-02-12 14:50:11,271 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52986, dest: /127.0.0.1:50546, bytes: 68410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234, duration: 8352522000
2015-02-12 14:50:11,271 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16349
2015-02-12 14:50:11,273 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:52985, dest: /127.0.0.1:50539, bytes: 68410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234, duration: 8354366000
2015-02-12 14:50:11,273 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742058_1234, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,273 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16349
2015-02-12 14:50:11,274 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,279 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:50:11,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240 src: /127.0.0.1:53030 dest: /127.0.0.1:50543
2015-02-12 14:50:11,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240 src: /127.0.0.1:53031 dest: /127.0.0.1:50539
2015-02-12 14:50:11,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240 src: /127.0.0.1:53032 dest: /127.0.0.1:50546
2015-02-12 14:50:11,287 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53032, dest: /127.0.0.1:50546, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240, duration: 1187000
2015-02-12 14:50:11,288 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:11,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,288 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53031, dest: /127.0.0.1:50539, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240, duration: 2090000
2015-02-12 14:50:11,289 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,291 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53030, dest: /127.0.0.1:50543, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240, duration: 3715000
2015-02-12 14:50:11,291 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,294 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary_tmp is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:11,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:11,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:11,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:11,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:11,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:11,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,326 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:50:11,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241 src: /127.0.0.1:53034 dest: /127.0.0.1:50543
2015-02-12 14:50:11,329 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241 src: /127.0.0.1:53035 dest: /127.0.0.1:50549
2015-02-12 14:50:11,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241 src: /127.0.0.1:53036 dest: /127.0.0.1:50539
2015-02-12 14:50:11,334 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53036, dest: /127.0.0.1:50539, bytes: 68410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241, duration: 1599000
2015-02-12 14:50:11,334 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:11,335 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53035, dest: /127.0.0.1:50549, bytes: 68410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241, duration: 2225000
2015-02-12 14:50:11,335 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,335 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,336 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53034, dest: /127.0.0.1:50543, bytes: 68410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241, duration: 3314000
2015-02-12 14:50:11,338 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,338 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,338 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,340 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:11,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:11,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:11,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:11,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:11,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021/job_1423780884992_0021_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:11,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:11,354 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:11,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242 src: /127.0.0.1:53038 dest: /127.0.0.1:50546
2015-02-12 14:50:11,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242 src: /127.0.0.1:53039 dest: /127.0.0.1:50549
2015-02-12 14:50:11,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242 src: /127.0.0.1:53040 dest: /127.0.0.1:50543
2015-02-12 14:50:11,365 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53040, dest: /127.0.0.1:50543, bytes: 113550, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242, duration: 1813000
2015-02-12 14:50:11,365 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:11,365 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,366 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53039, dest: /127.0.0.1:50549, bytes: 113550, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242, duration: 2604000
2015-02-12 14:50:11,366 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:11,367 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53038, dest: /127.0.0.1:50546, bytes: 113550, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2006873559_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242, duration: 3485000
2015-02-12 14:50:11,367 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:11,370 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742066_1242 size 113550
2015-02-12 14:50:11,370 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2006873559_1
2015-02-12 14:50:11,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:11,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:11,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:11,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:11,396 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0021_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:50:11,397 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:11,397 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0021 with final state: FINISHING
2015-02-12 14:50:11,397 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:11,397 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0021
2015-02-12 14:50:11,397 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:11,397 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:12,162 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:12,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:12,162 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:50:12,162 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000008
2015-02-12 14:50:12,162 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:12,163 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000008 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:12,404 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0021 unregistered successfully.
2015-02-12 14:50:12,409 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742046_1222 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:50:12,409 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742048_1224 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:50:12,410 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742050_1226 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:50:12,410 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742052_1228 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:50:12,410 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742056_1232 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:50:12,410 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742058_1234 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:50:12,410 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742055_1231 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:50:12,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0021 dst=null perm=null proto=rpc
2015-02-12 14:50:12,444 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (3/3) ...dpipesplatform/afterevery
2015-02-12 14:50:12,455 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:50:12,499 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:50:12,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:12,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:12,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:12,507 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 22
2015-02-12 14:50:12,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022 dst=null perm=null proto=rpc
2015-02-12 14:50:12,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:50:12,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:50:12,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,519 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:50:12,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 src: /127.0.0.1:53043 dest: /127.0.0.1:50549
2015-02-12 14:50:12,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 src: /127.0.0.1:53044 dest: /127.0.0.1:50539
2015-02-12 14:50:12,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 src: /127.0.0.1:53045 dest: /127.0.0.1:50546
2015-02-12 14:50:12,536 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53045, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243, duration: 3333000
2015-02-12 14:50:12,537 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:12,539 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53044, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243, duration: 6889000
2015-02-12 14:50:12,539 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,540 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,542 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53043, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243, duration: 10820000
2015-02-12 14:50:12,542 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,558 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,560 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,563 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:12,564 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar
2015-02-12 14:50:12,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:50:12,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:50:12,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:50:12,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:50:12,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:50:12,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:12,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:12,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:12,584 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:12,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:12,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:12,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:12,590 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:12,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:12,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:12,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:12,596 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:12,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:12,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:12,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:12,604 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:12,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,611 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split
2015-02-12 14:50:12,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:12,618 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:12,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244 src: /127.0.0.1:53046 dest: /127.0.0.1:50543
2015-02-12 14:50:12,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244 src: /127.0.0.1:53047 dest: /127.0.0.1:50539
2015-02-12 14:50:12,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244 src: /127.0.0.1:53048 dest: /127.0.0.1:50546
2015-02-12 14:50:12,629 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244 src: /127.0.0.1:53049 dest: /127.0.0.1:50549
2015-02-12 14:50:12,635 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53049, dest: /127.0.0.1:50549, bytes: 696, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, duration: 1811000
2015-02-12 14:50:12,635 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:12,636 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,636 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53048, dest: /127.0.0.1:50546, bytes: 696, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, duration: 2565000
2015-02-12 14:50:12,636 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,637 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,637 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53047, dest: /127.0.0.1:50539, bytes: 696, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, duration: 3738000
2015-02-12 14:50:12,637 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,638 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,639 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53046, dest: /127.0.0.1:50543, bytes: 696, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, duration: 5345000
2015-02-12 14:50:12,640 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,643 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,645 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:12,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,654 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:12,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245 src: /127.0.0.1:53050 dest: /127.0.0.1:50546
2015-02-12 14:50:12,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245 src: /127.0.0.1:53051 dest: /127.0.0.1:50539
2015-02-12 14:50:12,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245 src: /127.0.0.1:53052 dest: /127.0.0.1:50543
2015-02-12 14:50:12,665 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53052, dest: /127.0.0.1:50543, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245, duration: 3037000
2015-02-12 14:50:12,665 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:12,666 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,666 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53051, dest: /127.0.0.1:50539, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245, duration: 1941000
2015-02-12 14:50:12,666 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,667 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53050, dest: /127.0.0.1:50546, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245, duration: 3176000
2015-02-12 14:50:12,667 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,669 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,675 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,676 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:12,676 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:2
2015-02-12 14:50:12,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:12,689 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:12,691 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246 src: /127.0.0.1:53053 dest: /127.0.0.1:50549
2015-02-12 14:50:12,693 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246 src: /127.0.0.1:53054 dest: /127.0.0.1:50539
2015-02-12 14:50:12,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246 src: /127.0.0.1:53055 dest: /127.0.0.1:50543
2015-02-12 14:50:12,701 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53055, dest: /127.0.0.1:50543, bytes: 97881, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246, duration: 2280000
2015-02-12 14:50:12,701 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:12,702 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:12,702 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53054, dest: /127.0.0.1:50539, bytes: 97881, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246, duration: 2799000
2015-02-12 14:50:12,702 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,703 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:12,704 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53053, dest: /127.0.0.1:50549, bytes: 97881, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246, duration: 3804000
2015-02-12 14:50:12,704 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:12,708 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:12,710 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:12,711 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0022
2015-02-12 14:50:12,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022 dst=null perm=null proto=rpc
2015-02-12 14:50:12,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:12,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:12,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:12,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:12,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:12,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:12,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:12,733 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 22 submitted by user soberoi
2015-02-12 14:50:12,733 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0022
2015-02-12 14:50:12,733 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from NEW to NEW_SAVING
2015-02-12 14:50:12,733 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0022
2015-02-12 14:50:12,734 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0022
2015-02-12 14:50:12,734 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:50:12,734 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0022 from user: soberoi, in queue: default, currently num of applications: 3
2015-02-12 14:50:12,735 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from SUBMITTED to ACCEPTED
2015-02-12 14:50:12,735 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0022_000001
2015-02-12 14:50:12,735 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from NEW to SUBMITTED
2015-02-12 14:50:12,735 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0022
2015-02-12 14:50:12,735 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0022_000001 to scheduler from user: soberoi
2015-02-12 14:50:12,735 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:50:12,738 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0022/
2015-02-12 14:50:12,738 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0022
2015-02-12 14:50:12,738 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0022/
2015-02-12 14:50:13,041 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:13,041 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000001
2015-02-12 14:50:13,041 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0022_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:50:13,042 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0022_01_000001
2015-02-12 14:50:13,042 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:13,042 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0022_000001
2015-02-12 14:50:13,042 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0022 AttemptId: appattempt_1423780884992_0022_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0022_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:50:13,042 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:50:13,043 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:50:13,043 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0022_000001
2015-02-12 14:50:13,044 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0022_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0022_000001
2015-02-12 14:50:13,044 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0022_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:50:13,044 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0022_000001
2015-02-12 14:50:13,044 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0022_000001
2015-02-12 14:50:13,046 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:13,048 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0022_01_000001 by user soberoi
2015-02-12 14:50:13,048 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0022
2015-02-12 14:50:13,049 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000001
2015-02-12 14:50:13,049 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from NEW to INITING
2015-02-12 14:50:13,049 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0022_01_000001 to application application_1423780884992_0022
2015-02-12 14:50:13,049 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0022_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0022_000001
2015-02-12 14:50:13,049 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from INITING to RUNNING
2015-02-12 14:50:13,049 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:50:13,049 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742067_1243 to datanode(s) 127.0.0.1:50543
2015-02-12 14:50:13,049 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:50:13,049 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0022
2015-02-12 14:50:13,049 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742048_1224, blk_1073742049_1225, blk_1073742051_1227, blk_1073742052_1228, blk_1073742053_1229, blk_1073742054_1230, blk_1073742055_1231, blk_1073742057_1233, blk_1073742058_1234, blk_1073742045_1221, blk_1073742046_1222, blk_1073742047_1223]
2015-02-12 14:50:13,050 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:13,050 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:50:13,050 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742048_1224, blk_1073742050_1226, blk_1073742051_1227, blk_1073742052_1228, blk_1073742053_1229, blk_1073742054_1230, blk_1073742056_1232, blk_1073742057_1233, blk_1073742045_1221, blk_1073742046_1222, blk_1073742047_1223]
2015-02-12 14:50:13,050 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:50:13,050 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:13,050 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0022_01_000001
2015-02-12 14:50:13,060 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0022_01_000001.tokens. Credentials list:
2015-02-12 14:50:13,167 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:13,167 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:13,182 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:13,292 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0022_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000001.tokens
2015-02-12 14:50:13,292 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:13,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:13,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:13,439 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:13,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:13,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:13,534 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0022/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:13,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:13,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:13,619 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0022/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:13,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:13,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:13,686 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0022/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:13,686 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:13,722 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:13,722 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:13,864 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000001/default_container_executor.sh]
2015-02-12 14:50:14,043 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:14,172 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:14,172 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:14,250 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 to 127.0.0.1:50543
2015-02-12 14:50:14,251 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048 for deletion
2015-02-12 14:50:14,251 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742049_1225 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742049 for deletion
2015-02-12 14:50:14,251 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742051_1227 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742051 for deletion
2015-02-12 14:50:14,251 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048
2015-02-12 14:50:14,251 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742052 for deletion
2015-02-12 14:50:14,251 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742053_1229 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742053 for deletion
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742051_1227 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742051
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742054_1230 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742054 for deletion
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742055 for deletion
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742057 for deletion
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742058 for deletion
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045 for deletion
2015-02-12 14:50:14,252 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046 for deletion
2015-02-12 14:50:14,253 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047 for deletion
2015-02-12 14:50:14,252 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:50:14,253 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742054_1230 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742054
2015-02-12 14:50:14,254 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 src: /127.0.0.1:53064 dest: /127.0.0.1:50543
2015-02-12 14:50:14,254 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742057
2015-02-12 14:50:14,253 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742049_1225 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742049
2015-02-12 14:50:14,254 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742052
2015-02-12 14:50:14,255 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742053_1229 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742053
2015-02-12 14:50:14,256 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742055
2015-02-12 14:50:14,257 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742058
2015-02-12 14:50:14,258 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047
2015-02-12 14:50:14,254 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045
2015-02-12 14:50:14,260 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046
2015-02-12 14:50:14,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243 src: /127.0.0.1:53064 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:50:14,263 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742067_1243 size 254067
2015-02-12 14:50:14,503 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048 for deletion
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742050_1226 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742050 for deletion
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742051_1227 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742051 for deletion
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742052 for deletion
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742050_1226 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742050
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742051_1227 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742051
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742053_1229 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742053 for deletion
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742052
2015-02-12 14:50:14,504 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742054_1230 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742054 for deletion
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742056 for deletion
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742057 for deletion
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045 for deletion
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742053_1229 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742053
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046 for deletion
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742056
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047 for deletion
2015-02-12 14:50:14,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742054_1230 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742054
2015-02-12 14:50:14,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046
2015-02-12 14:50:14,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742057
2015-02-12 14:50:14,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045
2015-02-12 14:50:14,507 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047
2015-02-12 14:50:15,173 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:15,173 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:15,583 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235
2015-02-12 14:50:15,584 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237
2015-02-12 14:50:15,585 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236
2015-02-12 14:50:16,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:16,052 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742048_1224, blk_1073742049_1225, blk_1073742050_1226, blk_1073742051_1227, blk_1073742052_1228, blk_1073742053_1229, blk_1073742054_1230, blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742058_1234, blk_1073742045_1221, blk_1073742046_1222, blk_1073742047_1223]
2015-02-12 14:50:16,052 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742048_1224, blk_1073742049_1225, blk_1073742050_1226, blk_1073742055_1231, blk_1073742056_1232, blk_1073742058_1234, blk_1073742045_1221, blk_1073742046_1222, blk_1073742047_1223]
2015-02-12 14:50:16,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:50:16,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:50:16,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:50:16,175 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:16,175 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:16,211 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235
2015-02-12 14:50:16,212 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238
2015-02-12 14:50:16,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236
2015-02-12 14:50:16,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022 dst=null perm=null proto=rpc
2015-02-12 14:50:16,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:50:16,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:50:16,302 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0020_01_000001 succeeded
2015-02-12 14:50:16,303 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:50:16,303 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0020_01_000001
2015-02-12 14:50:16,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000001
2015-02-12 14:50:16,324 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000001
2015-02-12 14:50:16,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000001
2015-02-12 14:50:16,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000001
2015-02-12 14:50:16,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020/container_1423780884992_0020_01_000001
2015-02-12 14:50:16,324 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0020_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:50:16,325 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0020_01_000001 from application application_1423780884992_0020
2015-02-12 14:50:16,325 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:16,325 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0020
2015-02-12 14:50:16,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:16,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048 for deletion
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742049_1225 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742049 for deletion
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742050_1226 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742050 for deletion
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742051_1227 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742051 for deletion
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742052 for deletion
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742049_1225 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742049
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742050_1226 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742050
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742051_1227 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742051
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742052
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742053_1229 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742053 for deletion
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742054_1230 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742054 for deletion
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742055 for deletion
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742056 for deletion
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742057 for deletion
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742053_1229 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742053
2015-02-12 14:50:16,908 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048 for deletion
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742055
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742049_1225 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742049 for deletion
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742050_1226 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742050 for deletion
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742055 for deletion
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742054_1230 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742054
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742057
2015-02-12 14:50:16,909 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742058 for deletion
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045 for deletion
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742048
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742049_1225 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742049
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742056
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742055
2015-02-12 14:50:16,910 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742056 for deletion
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742058
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742050_1226 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742050
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045
2015-02-12 14:50:16,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742056
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046 for deletion
2015-02-12 14:50:16,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047 for deletion
2015-02-12 14:50:16,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742058 for deletion
2015-02-12 14:50:16,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045 for deletion
2015-02-12 14:50:16,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046 for deletion
2015-02-12 14:50:16,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047 for deletion
2015-02-12 14:50:16,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046
2015-02-12 14:50:16,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047
2015-02-12 14:50:16,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742046
2015-02-12 14:50:16,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742058
2015-02-12 14:50:16,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742045
2015-02-12 14:50:16,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742047_1223 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742047
2015-02-12 14:50:17,178 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0020_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:17,178 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0020_000001
2015-02-12 14:50:17,178 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0020_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:50:17,178 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0020_000001
2015-02-12 14:50:17,178 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0020_000001 State change from FINISHING to FINISHED
2015-02-12 14:50:17,178 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000001
2015-02-12 14:50:17,178 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0020 State change from FINISHING to FINISHED
2015-02-12 14:50:17,178 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0020_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:17,178 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0020_000001
2015-02-12 14:50:17,179 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0020_000001 released container container_1423780884992_0020_01_000001 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:17,179 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:17,179 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:17,179 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0020
2015-02-12 14:50:17,179 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0020_000001 is done. finalState=FINISHED
2015-02-12 14:50:17,179 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0020,name=[087161660051449A90B68F05F9FBBD9A/A9B2DB1184BB413393F112B5252895DD] lower*upper/(1/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0020/jobhistory/job/job_1423780884992_0020,appMasterHost=10.1.1.67,startTime=1423781370401,finishTime=1423781410209,finalStatus=SUCCEEDED
2015-02-12 14:50:17,179 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0020 requests cleared
2015-02-12 14:50:17,181 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0020_000001 (auth:SIMPLE)
2015-02-12 14:50:17,183 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0020_01_000001
2015-02-12 14:50:17,183 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0020 CONTAINERID=container_1423780884992_0020_01_000001
2015-02-12 14:50:17,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0020_01_000001]
2015-02-12 14:50:17,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:17,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:17,184 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:17,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:17,184 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,185 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0020
2015-02-12 14:50:17,185 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:17,185 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0020, with delay of 10800 seconds
2015-02-12 14:50:17,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,247 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:17,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,248 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0020
2015-02-12 14:50:17,249 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,249 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:17,249 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0020, with delay of 10800 seconds
2015-02-12 14:50:17,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:17,461 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0021_01_000001 succeeded
2015-02-12 14:50:17,461 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:50:17,461 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0021_01_000001
2015-02-12 14:50:17,479 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000001
2015-02-12 14:50:17,479 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000001
2015-02-12 14:50:17,480 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000001
2015-02-12 14:50:17,480 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0021/container_1423780884992_0021_01_000001
2015-02-12 14:50:17,480 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000001
2015-02-12 14:50:17,480 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0021_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:50:17,480 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0021_01_000001 from application application_1423780884992_0021
2015-02-12 14:50:17,480 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:17,481 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0021
2015-02-12 14:50:17,863 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:17,867 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0022_000001
2015-02-12 14:50:17,867 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0022 APPATTEMPTID=appattempt_1423780884992_0022_000001
2015-02-12 14:50:17,867 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:50:17,868 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from ACCEPTED to RUNNING
2015-02-12 14:50:17,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:17,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:50:18,055 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:18,056 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0021_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:18,056 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0021_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:50:18,056 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000001
2015-02-12 14:50:18,056 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0021_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:18,056 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0021_000001 released container container_1423780884992_0021_01_000001 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:18,056 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0021_000001
2015-02-12 14:50:18,056 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0021_000001
2015-02-12 14:50:18,057 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0021_000001 State change from FINISHING to FINISHED
2015-02-12 14:50:18,057 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0021 State change from FINISHING to FINISHED
2015-02-12 14:50:18,057 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:18,057 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0021
2015-02-12 14:50:18,057 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0021,name=[087161660051449A90B68F05F9FBBD9A/440BA35AAC1A4D4BB69A85C7E17035C2] lower*upper/(2/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0021/jobhistory/job/job_1423780884992_0021,appMasterHost=10.1.1.67,startTime=1423781370422,finishTime=1423781411397,finalStatus=SUCCEEDED
2015-02-12 14:50:18,057 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0020
2015-02-12 14:50:18,057 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:18,057 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0020, with delay of 10800 seconds
2015-02-12 14:50:18,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:18,058 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0021_000001 is done. finalState=FINISHED
2015-02-12 14:50:18,058 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0021 requests cleared
2015-02-12 14:50:18,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:18,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0020
2015-02-12 14:50:18,058 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0021_000001
2015-02-12 14:50:18,062 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0021_000001 (auth:SIMPLE)
2015-02-12 14:50:18,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:18,064 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0021_01_000001
2015-02-12 14:50:18,064 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0021 CONTAINERID=container_1423780884992_0021_01_000001
2015-02-12 14:50:18,065 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0021_01_000001]
2015-02-12 14:50:18,065 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:18,065 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:18,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,066 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,066 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0021
2015-02-12 14:50:18,066 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:18,066 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0021, with delay of 10800 seconds
2015-02-12 14:50:18,066 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,067 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,185 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:18,185 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:18,186 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:18,186 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,186 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0021
2015-02-12 14:50:18,186 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:18,186 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0021, with delay of 10800 seconds
2015-02-12 14:50:18,186 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,187 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,396 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:18,415 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:18,415 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,416 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0021
2015-02-12 14:50:18,416 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:18,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,416 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0021, with delay of 10800 seconds
2015-02-12 14:50:18,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0021
2015-02-12 14:50:18,455 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247 src: /127.0.0.1:53074 dest: /127.0.0.1:50539
2015-02-12 14:50:18,457 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247 src: /127.0.0.1:53075 dest: /127.0.0.1:50543
2015-02-12 14:50:18,458 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247 src: /127.0.0.1:53076 dest: /127.0.0.1:50549
2015-02-12 14:50:18,497 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53076, dest: /127.0.0.1:50549, bytes: 114596, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247, duration: 37465000
2015-02-12 14:50:18,498 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:18,498 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:18,498 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53075, dest: /127.0.0.1:50543, bytes: 114596, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247, duration: 38443000
2015-02-12 14:50:18,500 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:18,501 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53074, dest: /127.0.0.1:50539, bytes: 114596, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247, duration: 41491000
2015-02-12 14:50:18,502 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:18,503 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:18,504 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:18,512 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1_conf.xml is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:18,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:18,547 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:18,551 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248 src: /127.0.0.1:53077 dest: /127.0.0.1:50539
2015-02-12 14:50:18,553 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248 src: /127.0.0.1:53078 dest: /127.0.0.1:50546
2015-02-12 14:50:18,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248 src: /127.0.0.1:53079 dest: /127.0.0.1:50543
2015-02-12 14:50:18,559 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53079, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248, duration: 1974000
2015-02-12 14:50:18,559 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:18,560 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:18,560 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53078, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248, duration: 2255000
2015-02-12 14:50:18,560 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:18,561 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53077, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248, duration: 3975000
2015-02-12 14:50:18,561 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:18,562 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:18,563 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:18,567 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022.summary is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:19,067 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:19,067 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000002
2015-02-12 14:50:19,068 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0022_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:50:19,189 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:19,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:19,190 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000003
2015-02-12 14:50:19,190 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0022_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:50:19,781 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241
2015-02-12 14:50:19,782 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742059_1235
2015-02-12 14:50:19,782 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239
2015-02-12 14:50:19,782 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742060_1236
2015-02-12 14:50:19,783 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240
2015-02-12 14:50:19,938 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0022_01_000002
2015-02-12 14:50:19,938 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:19,938 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0022_01_000003
2015-02-12 14:50:19,938 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:19,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:19,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:19,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243
2015-02-12 14:50:19,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244
2015-02-12 14:50:19,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242
2015-02-12 14:50:19,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:19,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:19,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:19,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,079 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:20,079 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:20,082 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0022_01_000003 by user soberoi
2015-02-12 14:50:20,082 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0022_01_000002 by user soberoi
2015-02-12 14:50:20,082 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0022
2015-02-12 14:50:20,082 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000002
2015-02-12 14:50:20,082 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0022_01_000002 to application application_1423780884992_0022
2015-02-12 14:50:20,082 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from NEW to INITING
2015-02-12 14:50:20,082 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0022_01_000003 to application application_1423780884992_0022
2015-02-12 14:50:20,082 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:50:20,083 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from INITING to RUNNING
2015-02-12 14:50:20,082 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000003
2015-02-12 14:50:20,083 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:50:20,083 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0022
2015-02-12 14:50:20,083 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0022
2015-02-12 14:50:20,083 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:20,083 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0022
2015-02-12 14:50:20,083 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:20,083 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0022
2015-02-12 14:50:20,084 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:20,084 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0022_01_000003
2015-02-12 14:50:20,084 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0022
2015-02-12 14:50:20,084 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:20,084 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0022
2015-02-12 14:50:20,085 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:20,098 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0022_01_000003.tokens. Credentials list:
2015-02-12 14:50:20,122 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:20,122 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:20,131 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245
2015-02-12 14:50:20,132 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239
2015-02-12 14:50:20,133 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238
2015-02-12 14:50:20,185 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742062_1238
2015-02-12 14:50:20,185 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245
2015-02-12 14:50:20,186 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237
2015-02-12 14:50:20,191 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:20,258 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:20,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000002/default_container_executor.sh]
2015-02-12 14:50:20,333 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243
2015-02-12 14:50:20,334 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742061_1237
2015-02-12 14:50:20,335 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240
2015-02-12 14:50:20,335 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244
2015-02-12 14:50:20,384 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246
2015-02-12 14:50:20,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0022_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000003.tokens
2015-02-12 14:50:20,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:20,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:20,534 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246
2015-02-12 14:50:20,535 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241
2015-02-12 14:50:20,578 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0022/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:20,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:20,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:20,659 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0022/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:20,659 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:20,703 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:20,703 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:20,796 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243
2015-02-12 14:50:20,796 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742063_1239
2015-02-12 14:50:20,796 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244
2015-02-12 14:50:20,797 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242
2015-02-12 14:50:20,798 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742069_1245
2015-02-12 14:50:20,798 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742064_1240
2015-02-12 14:50:20,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000003/default_container_executor.sh]
2015-02-12 14:50:20,950 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:50:21,072 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:21,218 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742068_1244
2015-02-12 14:50:21,219 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742070_1246
2015-02-12 14:50:21,423 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742067_1243
2015-02-12 14:50:21,423 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742065_1241
2015-02-12 14:50:21,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742066_1242
2015-02-12 14:50:23,502 INFO hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 14:50:23,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:50:23,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:50:23,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,511 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0016,submitTime=1423781270211,launchTime=1423781274371,firstMapTaskLaunchTime=1423781276584,firstReduceTaskLaunchTime=1423781289483,finishTime=1423781292915,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=51,reduceSlotSeconds=3,jobName=[14481078A6E6441D98B6D1970BC11105/D5AE788ECD3C41C6B1748CC4496191D2] lhs/(1/1) ...edpipesplatform/samepipe3
2015-02-12 14:50:23,511 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary]
2015-02-12 14:50:23,511 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0014,submitTime=1423781219393,launchTime=1423781223485,firstMapTaskLaunchTime=1423781225666,firstReduceTaskLaunchTime=1423781240639,finishTime=1423781243926,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=74,reduceSlotSeconds=3,jobName=[C5A8FAF0C94E40EFA5284C67EE2607A8/05F829A76A4D4AB4BE7844842E33747E] lower*upper/(1/1) ...dpipesplatform/difffields
2015-02-12 14:50:23,511 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary]
2015-02-12 14:50:23,511 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0015,submitTime=1423781245395,launchTime=1423781249399,firstMapTaskLaunchTime=1423781251555,firstReduceTaskLaunchTime=1423781265458,finishTime=1423781268621,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=59,reduceSlotSeconds=3,jobName=[D6A2E4E25CA14DF4B9B13582ED0223E1/C3710DC4068645748772690322E8BC4C] lower/(1/1) ...edpipesplatform/samepipe2
2015-02-12 14:50:23,511 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary]
2015-02-12 14:50:23,513 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742007_1183 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:50:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,513 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741996_1172 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:50:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,514 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741985_1161 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:50:23,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,517 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist
2015-02-12 14:50:23,517 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist
2015-02-12 14:50:23,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,517 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist
2015-02-12 14:50:23,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0016-1423781270211-soberoi-%5B14481078A6E6441D98B6D1970BC11105%2FD5AE788ECD3C41C6-1423781292915-5-1-SUCCEEDED-root.soberoi-1423781274371.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,518 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0016_conf.xml
2015-02-12 14:50:23,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0015-1423781245395-soberoi-%5BD6A2E4E25CA14DF4B9B13582ED0223E1%2FC3710DC406864574-1423781268621-5-1-SUCCEEDED-root.soberoi-1423781249399.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0014-1423781219393-soberoi-%5BC5A8FAF0C94E40EFA5284C67EE2607A8%2F05F829A76A4D4AB4-1423781243926-6-1-SUCCEEDED-root.soberoi-1423781223485.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,519 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0015_conf.xml
2015-02-12 14:50:23,519 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0014_conf.xml
2015-02-12 14:50:23,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0016_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0016_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0015_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0015_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0014_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0014_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,522 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0018,submitTime=1423781320313,launchTime=1423781324736,firstMapTaskLaunchTime=1423781326868,firstReduceTaskLaunchTime=1423781339789,finishTime=1423781342852,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=51,reduceSlotSeconds=3,jobName=[183C996BCE40452C9738BB9E64A20F82/0340FE90E302444D9B25DBA542D070E2] lower/(1/1) ...dedpipesplatform/samepipe
2015-02-12 14:50:23,522 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0017,submitTime=1423781294508,launchTime=1423781299266,firstMapTaskLaunchTime=1423781301452,firstReduceTaskLaunchTime=1423781315386,finishTime=1423781318823,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=57,reduceSlotSeconds=3,jobName=[060CF11AF99843BA87D87F2D7C396060/52322782CE9946C9B3CBFAB8E5295A1A] lhs*rhs/(1/1) ...ieldedpipesplatform/cross
2015-02-12 14:50:23,522 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary]
2015-02-12 14:50:23,522 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary]
2015-02-12 14:50:23,523 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0019,submitTime=1423781344333,launchTime=1423781348546,firstMapTaskLaunchTime=1423781350733,firstReduceTaskLaunchTime=1423781365657,finishTime=1423781368765,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=72,reduceSlotSeconds=3,jobName=[6041344F38564BC7B8297E587F5661E3/F1B352A7ACAB4D78AC4AF978EDF8FE93] lower*upper/(1/1) ...dedpipesplatform/joinnone
2015-02-12 14:50:23,523 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary]
2015-02-12 14:50:23,523 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742031_1207 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:50:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,524 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742042_1218 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:50:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,524 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742020_1196 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:50:23,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,527 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist
2015-02-12 14:50:23,527 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist
2015-02-12 14:50:23,527 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist
2015-02-12 14:50:23,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0018-1423781320313-soberoi-%5B183C996BCE40452C9738BB9E64A20F82%2F0340FE90E302444D-1423781342852-5-1-SUCCEEDED-root.soberoi-1423781324736.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,529 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0018_conf.xml
2015-02-12 14:50:23,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0017-1423781294508-soberoi-%5B060CF11AF99843BA87D87F2D7C396060%2F52322782CE9946C9-1423781318823-5-1-SUCCEEDED-root.soberoi-1423781299266.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,529 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0017_conf.xml
2015-02-12 14:50:23,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0019-1423781344333-soberoi-%5B6041344F38564BC7B8297E587F5661E3%2FF1B352A7ACAB4D78-1423781368765-6-1-SUCCEEDED-root.soberoi-1423781348546.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,530 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0019_conf.xml
2015-02-12 14:50:23,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0018_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0018_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0017_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0017_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0019_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0019_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,532 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0020,submitTime=1423781370401,launchTime=1423781377467,firstMapTaskLaunchTime=1423781379670,firstReduceTaskLaunchTime=1423781404647,finishTime=1423781410018,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=111,reduceSlotSeconds=5,jobName=[087161660051449A90B68F05F9FBBD9A/A9B2DB1184BB413393F112B5252895DD] lower*upper/(1/3)
2015-02-12 14:50:23,532 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0021,submitTime=1423781370422,launchTime=1423781378314,firstMapTaskLaunchTime=1423781380934,firstReduceTaskLaunchTime=1423781405521,finishTime=1423781411239,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=110,reduceSlotSeconds=5,jobName=[087161660051449A90B68F05F9FBBD9A/440BA35AAC1A4D4BB69A85C7E17035C2] lower*upper/(2/3)
2015-02-12 14:50:23,532 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary]
2015-02-12 14:50:23,532 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary]
2015-02-12 14:50:23,535 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742060_1236 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:50:23,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,536 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742064_1240 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:50:23,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021.summary dst=null perm=null proto=rpc
2015-02-12 14:50:23,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:50:23,541 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist
2015-02-12 14:50:23,542 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist
2015-02-12 14:50:23,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0020-1423781370401-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2FA9B2DB1184BB4133-1423781410018-5-1-SUCCEEDED-root.soberoi-1423781377467.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,543 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0020_conf.xml
2015-02-12 14:50:23,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0021-1423781370422-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F440BA35AAC1A4D4B-1423781411239-5-1-SUCCEEDED-root.soberoi-1423781378314.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,544 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0021_conf.xml
2015-02-12 14:50:23,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0020_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0020_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0021_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0021_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:23,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:23,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2015-02-12 14:50:24,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:24,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:24,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:24,331 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:24,333 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0022_01_000002
2015-02-12 14:50:24,333 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000002
2015-02-12 14:50:24,333 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:50:24,333 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0022_01_000002
2015-02-12 14:50:24,352 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:24,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249 src: /127.0.0.1:53098 dest: /127.0.0.1:50543
2015-02-12 14:50:24,357 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0022_01_000002 is : 143
2015-02-12 14:50:24,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249 src: /127.0.0.1:53099 dest: /127.0.0.1:50546
2015-02-12 14:50:24,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249 src: /127.0.0.1:53100 dest: /127.0.0.1:50549
2015-02-12 14:50:24,367 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:24,368 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000002
2015-02-12 14:50:24,368 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000002
2015-02-12 14:50:24,368 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000002
2015-02-12 14:50:24,368 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000002
2015-02-12 14:50:24,368 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000002
2015-02-12 14:50:24,368 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:24,369 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0022_01_000002 from application application_1423780884992_0022
2015-02-12 14:50:24,369 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:24,369 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0022
2015-02-12 14:50:24,369 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist for DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:24,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:24,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:24,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:24,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:50:24,860 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:24,861 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0022_01_000003
2015-02-12 14:50:24,861 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000003
2015-02-12 14:50:24,862 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:50:24,862 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0022_01_000003
2015-02-12 14:50:24,874 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0022_01_000003 is : 143
2015-02-12 14:50:24,880 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:24,880 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000003
2015-02-12 14:50:24,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000003
2015-02-12 14:50:24,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000003
2015-02-12 14:50:24,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000003
2015-02-12 14:50:24,881 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000003
2015-02-12 14:50:24,881 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:24,881 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0022_01_000003 from application application_1423780884992_0022
2015-02-12 14:50:24,881 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:24,882 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0022
2015-02-12 14:50:25,061 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742064_1240, blk_1073742020_1196, blk_1073742007_1183, blk_1073742042_1218, blk_1073742060_1236, blk_1073741996_1172, blk_1073742031_1207]
2015-02-12 14:50:25,062 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742064_1240, blk_1073741985_1161, blk_1073742020_1196, blk_1073742042_1218, blk_1073742060_1236, blk_1073741996_1172, blk_1073742031_1207]
2015-02-12 14:50:25,336 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:25,336 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0022_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:50:25,336 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000002
2015-02-12 14:50:25,336 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0022_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:25,336 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0022_000001 released container container_1423780884992_0022_01_000002 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:25,390 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248
2015-02-12 14:50:25,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247
2015-02-12 14:50:25,541 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248
2015-02-12 14:50:25,543 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247
2015-02-12 14:50:25,804 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742072_1248
2015-02-12 14:50:25,867 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:25,867 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0022_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:50:25,867 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000003
2015-02-12 14:50:25,867 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0022_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:25,867 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0022_000001 released container container_1423780884992_0022_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:25,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742064_1240 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742064 for deletion
2015-02-12 14:50:25,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742020 for deletion
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742007 for deletion
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742064_1240 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742064
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742042 for deletion
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741996 for deletion
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742060_1236 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742060 for deletion
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742031_1207 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742031 for deletion
2015-02-12 14:50:25,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742020
2015-02-12 14:50:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741996
2015-02-12 14:50:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742007
2015-02-12 14:50:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742042
2015-02-12 14:50:25,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742060_1236 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742060
2015-02-12 14:50:25,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742031_1207 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742031
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742064_1240 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742064 for deletion
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741985_1161 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741985 for deletion
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742020 for deletion
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742042 for deletion
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741996 for deletion
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742064_1240 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742064
2015-02-12 14:50:26,259 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742060_1236 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742060 for deletion
2015-02-12 14:50:26,260 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742031_1207 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742031 for deletion
2015-02-12 14:50:26,260 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742020
2015-02-12 14:50:26,260 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741985_1161 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741985
2015-02-12 14:50:26,260 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741996
2015-02-12 14:50:26,260 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742042
2015-02-12 14:50:26,261 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742060_1236 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742060
2015-02-12 14:50:26,261 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742031_1207 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742031
2015-02-12 14:50:26,261 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:26,262 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000004
2015-02-12 14:50:26,262 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0022_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:50:26,338 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:26,627 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742071_1247
2015-02-12 14:50:26,868 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:26,984 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0022_01_000004
2015-02-12 14:50:26,984 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:26,996 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:26,998 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0022_01_000004 by user soberoi
2015-02-12 14:50:26,999 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0022
2015-02-12 14:50:26,999 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000004
2015-02-12 14:50:26,999 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from NEW to INITING
2015-02-12 14:50:26,999 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0022_01_000004 to application application_1423780884992_0022
2015-02-12 14:50:26,999 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from INITING to RUNNING
2015-02-12 14:50:27,000 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:50:27,000 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0022
2015-02-12 14:50:27,000 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0022
2015-02-12 14:50:27,000 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:27,000 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0022
2015-02-12 14:50:27,000 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:27,000 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:27,001 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0022_01_000004
2015-02-12 14:50:27,010 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0022_01_000004.tokens. Credentials list:
2015-02-12 14:50:27,123 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:27,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0022_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000004.tokens
2015-02-12 14:50:27,222 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:27,266 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:27,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:27,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:27,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0022_01_000002]
2015-02-12 14:50:27,339 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:27,356 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0022/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:27,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:27,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:27,425 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0022/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:27,425 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:27,482 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:27,482 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:27,583 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000004/default_container_executor.sh]
2015-02-12 14:50:27,873 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0022_01_000003]
2015-02-12 14:50:27,873 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:27,989 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:50:28,064 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073741985_1161, blk_1073742007_1183, blk_1073742042_1218, blk_1073742060_1236, blk_1073742031_1207]
2015-02-12 14:50:28,064 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742064_1240, blk_1073741985_1161, blk_1073742020_1196, blk_1073742007_1183, blk_1073741996_1172]
2015-02-12 14:50:28,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742064_1240 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742064 for deletion
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741985_1161 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741985 for deletion
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742020 for deletion
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742007 for deletion
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742064_1240 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742064
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741996 for deletion
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742020
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741985_1161 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741985
2015-02-12 14:50:28,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742007
2015-02-12 14:50:28,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741996
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741985_1161 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741985 for deletion
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742007 for deletion
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742042 for deletion
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742060_1236 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742060 for deletion
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073741985_1161 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073741985
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742031_1207 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742031 for deletion
2015-02-12 14:50:29,518 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742007
2015-02-12 14:50:29,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742031_1207 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742031
2015-02-12 14:50:29,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742042
2015-02-12 14:50:29,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742060_1236 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742060
2015-02-12 14:50:30,024 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:30,026 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:30,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,303 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:30,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250 src: /127.0.0.1:53126 dest: /127.0.0.1:50539
2015-02-12 14:50:30,406 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250 src: /127.0.0.1:53127 dest: /127.0.0.1:50543
2015-02-12 14:50:30,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250 src: /127.0.0.1:53128 dest: /127.0.0.1:50549
2015-02-12 14:50:30,450 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53128, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0022_r_000000_0_-663484406_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250, duration: 40895000
2015-02-12 14:50:30,451 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:30,451 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,452 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53127, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0022_r_000000_0_-663484406_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250, duration: 42130000
2015-02-12 14:50:30,452 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,453 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53126, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0022_r_000000_0_-663484406_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250, duration: 43185000
2015-02-12 14:50:30,453 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,453 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,454 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,460 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0022_r_000000_0_-663484406_1
2015-02-12 14:50:30,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:30,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:30,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/task_1423780884992_0022_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:30,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1423780884992_0022_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/task_1423780884992_0022_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:50:30,511 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:30,513 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0022_01_000004
2015-02-12 14:50:30,514 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000004
2015-02-12 14:50:30,514 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:50:30,514 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0022_01_000004
2015-02-12 14:50:30,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,522 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:50:30,535 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0022_01_000004 is : 143
2015-02-12 14:50:30,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:30,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:30,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/task_1423780884992_0022_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:30,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:30,548 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:30,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary/1/task_1423780884992_0022_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000004
2015-02-12 14:50:30,550 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000004
2015-02-12 14:50:30,550 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:30,550 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0022_01_000004 from application application_1423780884992_0022
2015-02-12 14:50:30,550 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:30,551 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0022
2015-02-12 14:50:30,552 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000004
2015-02-12 14:50:30,553 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000004
2015-02-12 14:50:30,553 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000004
2015-02-12 14:50:30,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary dst=null perm=null proto=rpc
2015-02-12 14:50:30,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,564 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_SUCCESS is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,569 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,595 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53100, dest: /127.0.0.1:50549, bytes: 45764, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249, duration: 6232341000
2015-02-12 14:50:30,595 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:30,596 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 14394
2015-02-12 14:50:30,597 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53099, dest: /127.0.0.1:50546, bytes: 45764, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249, duration: 6233365000
2015-02-12 14:50:30,597 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,598 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 14394
2015-02-12 14:50:30,599 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53098, dest: /127.0.0.1:50543, bytes: 45764, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249, duration: 6236782000
2015-02-12 14:50:30,599 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,601 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 14394
2015-02-12 14:50:30,603 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,608 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:50:30,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251 src: /127.0.0.1:53130 dest: /127.0.0.1:50546
2015-02-12 14:50:30,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251 src: /127.0.0.1:53131 dest: /127.0.0.1:50543
2015-02-12 14:50:30,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251 src: /127.0.0.1:53132 dest: /127.0.0.1:50539
2015-02-12 14:50:30,626 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53132, dest: /127.0.0.1:50539, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251, duration: 2543000
2015-02-12 14:50:30,627 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:30,628 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53131, dest: /127.0.0.1:50543, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251, duration: 2993000
2015-02-12 14:50:30,628 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,628 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,629 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53130, dest: /127.0.0.1:50546, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251, duration: 3993000
2015-02-12 14:50:30,629 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,629 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,631 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742075_1251 size 454
2015-02-12 14:50:30,631 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary_tmp is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:30,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:30,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:30,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:30,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:30,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:30,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,666 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:30,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252 src: /127.0.0.1:53134 dest: /127.0.0.1:50543
2015-02-12 14:50:30,672 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252 src: /127.0.0.1:53135 dest: /127.0.0.1:50546
2015-02-12 14:50:30,674 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252 src: /127.0.0.1:53136 dest: /127.0.0.1:50549
2015-02-12 14:50:30,677 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53136, dest: /127.0.0.1:50549, bytes: 45764, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252, duration: 1892000
2015-02-12 14:50:30,678 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:30,678 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53135, dest: /127.0.0.1:50546, bytes: 45764, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252, duration: 2426000
2015-02-12 14:50:30,679 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,678 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:50:30,680 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53134, dest: /127.0.0.1:50543, bytes: 45764, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252, duration: 3810000
2015-02-12 14:50:30,680 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,680 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:50:30,681 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,683 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:30,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:30,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:30,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:30,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:30,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022/job_1423780884992_0022_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:30,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:30,702 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:50:30,704 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253 src: /127.0.0.1:53138 dest: /127.0.0.1:50543
2015-02-12 14:50:30,706 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253 src: /127.0.0.1:53139 dest: /127.0.0.1:50549
2015-02-12 14:50:30,708 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253 src: /127.0.0.1:53140 dest: /127.0.0.1:50546
2015-02-12 14:50:30,715 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53140, dest: /127.0.0.1:50546, bytes: 114596, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253, duration: 3236000
2015-02-12 14:50:30,715 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:30,716 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:50:30,716 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53139, dest: /127.0.0.1:50549, bytes: 114596, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253, duration: 3516000
2015-02-12 14:50:30,716 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,717 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:50:30,717 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53138, dest: /127.0.0.1:50543, bytes: 114596, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_894754436_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253, duration: 5140000
2015-02-12 14:50:30,719 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:30,722 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:30,723 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_894754436_1
2015-02-12 14:50:30,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:30,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:30,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:30,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:30,744 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0022_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:50:30,745 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:30,745 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0022 with final state: FINISHING
2015-02-12 14:50:30,745 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:30,746 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:30,747 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0022
2015-02-12 14:50:30,747 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:31,519 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:31,519 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0022_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:50:31,520 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000004
2015-02-12 14:50:31,520 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0022_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:31,520 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0022_000001 released container container_1423780884992_0022_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:31,753 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0022 unregistered successfully.
2015-02-12 14:50:31,757 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742067_1243 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:50:31,758 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742068_1244 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:50:31,758 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742069_1245 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:50:31,758 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742070_1246 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:50:31,758 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742072_1248 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:50:31,758 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742073_1249 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:50:31,759 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742071_1247 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:50:31,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0022 dst=null perm=null proto=rpc
2015-02-12 14:50:31,800 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742059_1235 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:50:31,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/2394830952_lower_6E0BB8A872EB44D0A492C824341C2773 dst=null perm=null proto=rpc
2015-02-12 14:50:31,801 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742063_1239 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:50:31,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/661941565_upper_CF7C3B3D87FE4EE4AA23DB950ACBE344 dst=null perm=null proto=rpc
2015-02-12 14:50:31,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,803 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary
2015-02-12 14:50:31,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/_temporary dst=null perm=null proto=rpc
2015-02-12 14:50:31,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,818 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:31,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:31,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,838 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:31,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:31,841 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/afterevery
2015-02-12 14:50:31,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery dst=null perm=null proto=rpc
2015-02-12 14:50:31,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:31,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/afterevery/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:31,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,866 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:50:31,866 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:50:31,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:31,884 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] starting
2015-02-12 14:50:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] source: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:50:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:50:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields"]
2015-02-12 14:50:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] parallel execution is enabled: true
2015-02-12 14:50:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] starting jobs: 1
2015-02-12 14:50:31,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [offsetLower*lower] allocating threads: 1
2015-02-12 14:50:31,886 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [offsetLower*lower] starting step: (1/1) ...atform/samefiledifffields
2015-02-12 14:50:31,895 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:50:31,906 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:50:31,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:31,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:31,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:31,912 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 23
2015-02-12 14:50:31,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023 dst=null perm=null proto=rpc
2015-02-12 14:50:31,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:50:31,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:50:31,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:31,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:31,922 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:50:31,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 src: /127.0.0.1:53144 dest: /127.0.0.1:50549
2015-02-12 14:50:31,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 src: /127.0.0.1:53145 dest: /127.0.0.1:50546
2015-02-12 14:50:31,927 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 src: /127.0.0.1:53146 dest: /127.0.0.1:50539
2015-02-12 14:50:31,934 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53146, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254, duration: 2193000
2015-02-12 14:50:31,934 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:31,935 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,935 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53145, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254, duration: 2815000
2015-02-12 14:50:31,935 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:31,936 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53144, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254, duration: 3976000
2015-02-12 14:50:31,936 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,936 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:31,939 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,941 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:31,942 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar
2015-02-12 14:50:31,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:31,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:31,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:31,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:31,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:31,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:50:31,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:50:31,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:50:31,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:50:31,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:50:31,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:31,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,954 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:31,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,956 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:31,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,959 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:31,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,961 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:31,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:31,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:31,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:31,966 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split
2015-02-12 14:50:31,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:31,968 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:31,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255 src: /127.0.0.1:53147 dest: /127.0.0.1:50543
2015-02-12 14:50:31,971 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255 src: /127.0.0.1:53148 dest: /127.0.0.1:50546
2015-02-12 14:50:31,972 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255 src: /127.0.0.1:53149 dest: /127.0.0.1:50539
2015-02-12 14:50:31,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255 src: /127.0.0.1:53150 dest: /127.0.0.1:50549
2015-02-12 14:50:31,977 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53150, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, duration: 1647000
2015-02-12 14:50:31,977 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:31,977 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,978 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53149, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, duration: 2301000
2015-02-12 14:50:31,978 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:31,980 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53148, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, duration: 3688000
2015-02-12 14:50:31,980 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,981 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:31,982 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,982 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53147, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, duration: 6580000
2015-02-12 14:50:31,983 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:31,983 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:31,992 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:31,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:31,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:31,998 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:50:32,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256 src: /127.0.0.1:53151 dest: /127.0.0.1:50543
2015-02-12 14:50:32,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256 src: /127.0.0.1:53152 dest: /127.0.0.1:50546
2015-02-12 14:50:32,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256 src: /127.0.0.1:53153 dest: /127.0.0.1:50539
2015-02-12 14:50:32,009 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53153, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256, duration: 1103000
2015-02-12 14:50:32,009 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:32,010 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:32,010 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53152, dest: /127.0.0.1:50546, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256, duration: 1659000
2015-02-12 14:50:32,010 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:32,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:32,011 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53151, dest: /127.0.0.1:50543, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256, duration: 2758000
2015-02-12 14:50:32,011 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:32,013 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:32,014 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:32,014 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:50:32,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:32,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:32,034 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:50:32,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257 src: /127.0.0.1:53154 dest: /127.0.0.1:50543
2015-02-12 14:50:32,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257 src: /127.0.0.1:53155 dest: /127.0.0.1:50546
2015-02-12 14:50:32,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257 src: /127.0.0.1:53156 dest: /127.0.0.1:50549
2015-02-12 14:50:32,047 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53156, dest: /127.0.0.1:50549, bytes: 97592, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257, duration: 1870000
2015-02-12 14:50:32,047 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:32,048 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:32,048 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53155, dest: /127.0.0.1:50546, bytes: 97592, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257, duration: 2419000
2015-02-12 14:50:32,049 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:32,049 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:32,050 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53154, dest: /127.0.0.1:50543, bytes: 97592, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257, duration: 4267000
2015-02-12 14:50:32,050 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:32,053 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:32,054 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:32,055 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0023
2015-02-12 14:50:32,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023 dst=null perm=null proto=rpc
2015-02-12 14:50:32,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:32,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:32,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:32,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:32,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:32,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:32,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,071 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 23 submitted by user soberoi
2015-02-12 14:50:32,071 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0023
2015-02-12 14:50:32,071 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0023
2015-02-12 14:50:32,071 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0023
2015-02-12 14:50:32,071 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from NEW to NEW_SAVING
2015-02-12 14:50:32,071 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:50:32,071 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0023 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:50:32,072 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from SUBMITTED to ACCEPTED
2015-02-12 14:50:32,072 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0023
2015-02-12 14:50:32,072 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0023_000001
2015-02-12 14:50:32,072 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from NEW to SUBMITTED
2015-02-12 14:50:32,072 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0023_000001 to scheduler from user: soberoi
2015-02-12 14:50:32,073 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:50:32,075 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0023/
2015-02-12 14:50:32,075 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [offsetLower*lower] submitted hadoop job: job_1423780884992_0023
2015-02-12 14:50:32,075 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [offsetLower*lower] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0023/
2015-02-12 14:50:32,355 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:32,355 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000001
2015-02-12 14:50:32,355 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:50:32,355 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0023_01_000001
2015-02-12 14:50:32,356 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:32,356 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0023_000001
2015-02-12 14:50:32,356 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0023 AttemptId: appattempt_1423780884992_0023_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0023_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:50:32,356 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:50:32,357 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:50:32,357 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0023_000001
2015-02-12 14:50:32,358 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0023_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0023_000001
2015-02-12 14:50:32,358 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0023_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:50:32,358 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0023_000001
2015-02-12 14:50:32,358 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0023_000001
2015-02-12 14:50:32,360 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:32,362 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000001 by user soberoi
2015-02-12 14:50:32,363 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0023
2015-02-12 14:50:32,363 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000001
2015-02-12 14:50:32,363 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from NEW to INITING
2015-02-12 14:50:32,363 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000001 to application application_1423780884992_0023
2015-02-12 14:50:32,363 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from INITING to RUNNING
2015-02-12 14:50:32,363 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0023_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0023_000001
2015-02-12 14:50:32,363 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:50:32,363 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:50:32,364 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:32,364 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:32,364 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:50:32,364 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:50:32,364 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:32,364 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0023_01_000001
2015-02-12 14:50:32,373 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0023_01_000001.tokens. Credentials list:
2015-02-12 14:50:32,478 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:32,523 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:32,563 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0023_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000001.tokens
2015-02-12 14:50:32,564 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:50:32,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:32,696 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:32,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:32,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:32,756 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:32,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:32,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:32,822 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:32,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:32,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:32,888 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0023/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:32,888 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:32,924 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:32,925 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:33,046 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000001/default_container_executor.sh]
2015-02-12 14:50:33,358 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:33,526 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:34,071 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742078_1254 to datanode(s) 127.0.0.1:50543
2015-02-12 14:50:34,071 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742067_1243, blk_1073742068_1244, blk_1073742070_1246, blk_1073742071_1247, blk_1073742073_1249, blk_1073742059_1235]
2015-02-12 14:50:34,071 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742067_1243, blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742071_1247, blk_1073742072_1248, blk_1073742063_1239]
2015-02-12 14:50:34,528 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:34,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:34,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:50:34,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:50:34,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067 for deletion
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068 for deletion
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742069 for deletion
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742070 for deletion
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068
2015-02-12 14:50:34,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742070
2015-02-12 14:50:34,920 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742071 for deletion
2015-02-12 14:50:34,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742069
2015-02-12 14:50:34,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742072 for deletion
2015-02-12 14:50:34,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742063_1239 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742063 for deletion
2015-02-12 14:50:34,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742071
2015-02-12 14:50:34,921 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742072
2015-02-12 14:50:34,922 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742063_1239 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742063
2015-02-12 14:50:35,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023 dst=null perm=null proto=rpc
2015-02-12 14:50:35,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:50:35,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:50:35,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:35,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:35,520 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 to 127.0.0.1:50543
2015-02-12 14:50:35,520 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067 for deletion
2015-02-12 14:50:35,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068 for deletion
2015-02-12 14:50:35,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742070 for deletion
2015-02-12 14:50:35,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742071 for deletion
2015-02-12 14:50:35,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742073_1249 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742073 for deletion
2015-02-12 14:50:35,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742059 for deletion
2015-02-12 14:50:35,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067
2015-02-12 14:50:35,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742070
2015-02-12 14:50:35,522 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742073_1249 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742073
2015-02-12 14:50:35,523 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:50:35,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068
2015-02-12 14:50:35,523 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742071
2015-02-12 14:50:35,524 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742059
2015-02-12 14:50:35,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 src: /127.0.0.1:53165 dest: /127.0.0.1:50543
2015-02-12 14:50:35,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254 src: /127.0.0.1:53165 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:50:35,528 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742078_1254 size 254067
2015-02-12 14:50:35,529 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:35,558 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250
2015-02-12 14:50:35,814 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251
2015-02-12 14:50:35,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253
2015-02-12 14:50:35,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252
2015-02-12 14:50:35,816 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742073_1249
2015-02-12 14:50:36,302 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:36,304 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0023_000001
2015-02-12 14:50:36,304 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0023 APPATTEMPTID=appattempt_1423780884992_0023_000001
2015-02-12 14:50:36,304 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:50:36,304 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from ACCEPTED to RUNNING
2015-02-12 14:50:36,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:36,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:50:36,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:36,530 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:36,640 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250
2015-02-12 14:50:36,641 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252
2015-02-12 14:50:36,641 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253
2015-02-12 14:50:36,746 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:50:36,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258 src: /127.0.0.1:53170 dest: /127.0.0.1:50539
2015-02-12 14:50:36,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258 src: /127.0.0.1:53171 dest: /127.0.0.1:50546
2015-02-12 14:50:36,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258 src: /127.0.0.1:53172 dest: /127.0.0.1:50549
2015-02-12 14:50:36,814 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0022_01_000001 succeeded
2015-02-12 14:50:36,814 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:50:36,814 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0022_01_000001
2015-02-12 14:50:36,857 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53172, dest: /127.0.0.1:50549, bytes: 114307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258, duration: 48409000
2015-02-12 14:50:36,857 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:36,858 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:50:36,858 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53171, dest: /127.0.0.1:50546, bytes: 114307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258, duration: 49609000
2015-02-12 14:50:36,858 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:36,859 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000001
2015-02-12 14:50:36,860 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0022_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:50:36,860 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0022_01_000001 from application application_1423780884992_0022
2015-02-12 14:50:36,860 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53170, dest: /127.0.0.1:50539, bytes: 114307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258, duration: 51043000
2015-02-12 14:50:36,860 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:36,860 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:36,861 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0022
2015-02-12 14:50:36,860 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000001
2015-02-12 14:50:36,862 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000001
2015-02-12 14:50:36,862 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000001
2015-02-12 14:50:36,862 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:50:36,862 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022/container_1423780884992_0022_01_000001
2015-02-12 14:50:36,864 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:36,871 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:36,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:36,910 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:36,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259 src: /127.0.0.1:53173 dest: /127.0.0.1:50549
2015-02-12 14:50:36,914 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259 src: /127.0.0.1:53174 dest: /127.0.0.1:50539
2015-02-12 14:50:36,916 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259 src: /127.0.0.1:53175 dest: /127.0.0.1:50543
2015-02-12 14:50:36,920 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53175, dest: /127.0.0.1:50543, bytes: 401, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259, duration: 2359000
2015-02-12 14:50:36,921 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:36,921 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:36,921 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53174, dest: /127.0.0.1:50539, bytes: 401, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259, duration: 3409000
2015-02-12 14:50:36,922 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:36,922 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:36,922 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53173, dest: /127.0.0.1:50549, bytes: 401, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259, duration: 4425000
2015-02-12 14:50:36,923 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:36,923 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:36,925 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023.summary is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:37,073 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742067_1243, blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742071_1247, blk_1073742072_1248, blk_1073742073_1249, blk_1073742059_1235, blk_1073742063_1239]
2015-02-12 14:50:37,074 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742067_1243, blk_1073742068_1244, blk_1073742069_1245, blk_1073742072_1248, blk_1073742073_1249, blk_1073742059_1235, blk_1073742063_1239]
2015-02-12 14:50:37,376 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0022_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:37,376 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0022_000001
2015-02-12 14:50:37,376 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0022_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:50:37,376 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000001
2015-02-12 14:50:37,376 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0022_000001
2015-02-12 14:50:37,376 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0022_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:37,376 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0022_000001 State change from FINISHING to FINISHED
2015-02-12 14:50:37,376 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0022_000001 released container container_1423780884992_0022_01_000001 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:37,377 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0022 State change from FINISHING to FINISHED
2015-02-12 14:50:37,377 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0022
2015-02-12 14:50:37,377 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0022_000001
2015-02-12 14:50:37,377 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0022,name=[087161660051449A90B68F05F9FBBD9A/75E1719120A54FFB949905BFC5B9A0BD] lower*upper/(3/3) ...dpipesplatform/afterevery,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0022/jobhistory/job/job_1423780884992_0022,appMasterHost=10.1.1.67,startTime=1423781412733,finishTime=1423781430745,finalStatus=SUCCEEDED
2015-02-12 14:50:37,377 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:37,377 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000002
2015-02-12 14:50:37,377 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:50:37,377 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0022_000001 is done. finalState=FINISHED
2015-02-12 14:50:37,378 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0022 requests cleared
2015-02-12 14:50:37,379 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0022_000001 (auth:SIMPLE)
2015-02-12 14:50:37,381 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0022_01_000001
2015-02-12 14:50:37,381 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0022 CONTAINERID=container_1423780884992_0022_01_000001
2015-02-12 14:50:37,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0022_01_000001]
2015-02-12 14:50:37,382 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:37,382 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:37,382 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:37,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,382 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000003
2015-02-12 14:50:37,383 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0022
2015-02-12 14:50:37,383 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,383 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:37,383 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0022, with delay of 10800 seconds
2015-02-12 14:50:37,383 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,383 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:50:37,482 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:37,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000004
2015-02-12 14:50:37,483 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:50:37,530 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:37,530 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:37,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:37,530 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000005
2015-02-12 14:50:37,531 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:50:37,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,531 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0022
2015-02-12 14:50:37,531 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:37,531 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0022, with delay of 10800 seconds
2015-02-12 14:50:37,531 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,907 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:50:37,908 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:37,908 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000006
2015-02-12 14:50:37,908 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:50:37,908 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,909 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,909 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,909 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0022
2015-02-12 14:50:37,910 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0022
2015-02-12 14:50:37,910 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:50:37,910 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0022, with delay of 10800 seconds
2015-02-12 14:50:37,926 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067 for deletion
2015-02-12 14:50:37,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068 for deletion
2015-02-12 14:50:37,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742069 for deletion
2015-02-12 14:50:37,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742070 for deletion
2015-02-12 14:50:37,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068
2015-02-12 14:50:37,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067
2015-02-12 14:50:37,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742071 for deletion
2015-02-12 14:50:37,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742070
2015-02-12 14:50:37,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742069
2015-02-12 14:50:37,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742072 for deletion
2015-02-12 14:50:37,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742071
2015-02-12 14:50:37,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742073_1249 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742073 for deletion
2015-02-12 14:50:37,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742072
2015-02-12 14:50:37,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742059 for deletion
2015-02-12 14:50:37,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742063_1239 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742063 for deletion
2015-02-12 14:50:37,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742073_1249 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742073
2015-02-12 14:50:37,930 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742059
2015-02-12 14:50:37,930 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742063_1239 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742063
2015-02-12 14:50:38,273 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067 for deletion
2015-02-12 14:50:38,273 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068 for deletion
2015-02-12 14:50:38,273 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742069 for deletion
2015-02-12 14:50:38,274 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742067_1243 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742067
2015-02-12 14:50:38,274 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742068
2015-02-12 14:50:38,274 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742072 for deletion
2015-02-12 14:50:38,274 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742069
2015-02-12 14:50:38,274 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742073_1249 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742073 for deletion
2015-02-12 14:50:38,275 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742072
2015-02-12 14:50:38,275 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742059 for deletion
2015-02-12 14:50:38,275 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742073_1249 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742073
2015-02-12 14:50:38,275 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742063_1239 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742063 for deletion
2015-02-12 14:50:38,275 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742059
2015-02-12 14:50:38,276 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742063_1239 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742063
2015-02-12 14:50:38,386 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0023
2015-02-12 14:50:38,387 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:50:38,387 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0023_01_000007 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@767e3d2c
2015-02-12 14:50:38,398 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0023_01_000002
2015-02-12 14:50:38,398 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:38,399 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:38,399 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0023_01_000004
2015-02-12 14:50:38,399 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:38,400 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0023_01_000005
2015-02-12 14:50:38,400 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:38,400 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0023_01_000006
2015-02-12 14:50:38,400 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:38,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:38,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:38,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:38,484 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:38,484 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000008
2015-02-12 14:50:38,484 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:50:38,534 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:38,547 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:38,547 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:38,548 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:38,550 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:38,552 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000002 by user soberoi
2015-02-12 14:50:38,552 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000002
2015-02-12 14:50:38,553 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000002 to application application_1423780884992_0023
2015-02-12 14:50:38,553 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:50:38,553 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,553 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,553 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:38,553 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000006 by user soberoi
2015-02-12 14:50:38,553 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0023
2015-02-12 14:50:38,554 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000006
2015-02-12 14:50:38,553 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:38,554 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:38,555 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:38,555 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from NEW to INITING
2015-02-12 14:50:38,555 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000006 to application application_1423780884992_0023
2015-02-12 14:50:38,555 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from INITING to RUNNING
2015-02-12 14:50:38,555 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:50:38,555 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,556 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,556 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:38,556 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:38,556 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:38,556 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:38,556 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0023_01_000006
2015-02-12 14:50:38,560 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000003 by user soberoi
2015-02-12 14:50:38,560 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000003
2015-02-12 14:50:38,561 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000003 to application application_1423780884992_0023
2015-02-12 14:50:38,561 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:50:38,561 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,561 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,562 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:38,562 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:38,563 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:38,561 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000004 by user soberoi
2015-02-12 14:50:38,563 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0023
2015-02-12 14:50:38,564 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000004
2015-02-12 14:50:38,565 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from NEW to INITING
2015-02-12 14:50:38,565 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000004 to application application_1423780884992_0023
2015-02-12 14:50:38,566 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from INITING to RUNNING
2015-02-12 14:50:38,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:50:38,566 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,566 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,566 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:38,566 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:38,568 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:38,568 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:38,568 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0023_01_000004
2015-02-12 14:50:38,571 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000005 by user soberoi
2015-02-12 14:50:38,572 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0023
2015-02-12 14:50:38,572 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000005
2015-02-12 14:50:38,577 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from NEW to INITING
2015-02-12 14:50:38,577 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000005 to application application_1423780884992_0023
2015-02-12 14:50:38,577 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from INITING to RUNNING
2015-02-12 14:50:38,578 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:50:38,578 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,578 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:38,579 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:38,579 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:38,580 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:38,581 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:38,582 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0023_01_000005
2015-02-12 14:50:38,605 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0023_01_000006.tokens. Credentials list:
2015-02-12 14:50:38,607 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0023_01_000004.tokens. Credentials list:
2015-02-12 14:50:38,616 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0023_01_000005.tokens. Credentials list:
2015-02-12 14:50:38,642 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:38,642 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:38,647 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:38,647 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:38,870 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:38,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:38,894 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:38,908 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:38,918 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000002/default_container_executor.sh]
2015-02-12 14:50:38,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000003/default_container_executor.sh]
2015-02-12 14:50:39,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0023_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000005.tokens
2015-02-12 14:50:39,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:50:39,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0023_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000006.tokens
2015-02-12 14:50:39,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:50:39,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0023_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000004.tokens
2015-02-12 14:50:39,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:50:39,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:39,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:39,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:39,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:39,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:39,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:39,341 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0023/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:39,342 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0023/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:39,360 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0023/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:39,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:39,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:39,388 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0023_000001 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096
2015-02-12 14:50:39,389 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0023 unreserved on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:50:39,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:39,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:39,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:39,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:39,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:39,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:39,415 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:39,424 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:39,426 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000008 by user soberoi
2015-02-12 14:50:39,426 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000008
2015-02-12 14:50:39,426 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000008 to application application_1423780884992_0023
2015-02-12 14:50:39,427 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:50:39,427 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:39,427 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:39,427 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:39,427 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:39,428 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0023_01_000008
2015-02-12 14:50:39,452 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0023_01_000008.tokens. Credentials list:
2015-02-12 14:50:39,484 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0023/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:39,484 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:39,488 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:39,488 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:39,489 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:39,489 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000009
2015-02-12 14:50:39,489 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:50:39,492 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0023/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:39,493 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:39,500 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0023/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:39,500 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:39,500 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:39,535 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:39,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:39,566 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:39,572 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:39,573 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:39,581 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30006 milliseconds
2015-02-12 14:50:39,581 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:50:39,586 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:39,586 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:39,605 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:39,605 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:39,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000006/default_container_executor.sh]
2015-02-12 14:50:39,843 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000005/default_container_executor.sh]
2015-02-12 14:50:39,851 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000004/default_container_executor.sh]
2015-02-12 14:50:39,851 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000008/default_container_executor.sh]
2015-02-12 14:50:40,407 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742076_1252
2015-02-12 14:50:40,408 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742077_1253
2015-02-12 14:50:40,418 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:50:40,418 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:40,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:40,565 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255
2015-02-12 14:50:40,565 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251
2015-02-12 14:50:40,565 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256
2015-02-12 14:50:40,567 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254
2015-02-12 14:50:40,608 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257
2015-02-12 14:50:40,608 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255
2015-02-12 14:50:40,609 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742074_1250
2015-02-12 14:50:40,609 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256
2015-02-12 14:50:40,609 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742075_1251
2015-02-12 14:50:40,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0023_01_000008.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000008.tokens
2015-02-12 14:50:40,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:50:40,819 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742080_1256
2015-02-12 14:50:40,821 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254
2015-02-12 14:50:40,822 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255
2015-02-12 14:50:41,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257
2015-02-12 14:50:41,422 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:50:41,423 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:50:41,423 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000009
2015-02-12 14:50:41,423 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:50:41,423 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000009 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:50:41,495 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0023_01_000009
2015-02-12 14:50:41,645 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254
2015-02-12 14:50:41,646 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742079_1255
2015-02-12 14:50:41,846 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742081_1257
2015-02-12 14:50:45,575 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258
2015-02-12 14:50:45,575 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259
2015-02-12 14:50:45,615 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742078_1254
2015-02-12 14:50:45,615 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259
2015-02-12 14:50:46,026 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258
2015-02-12 14:50:46,851 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742082_1258
2015-02-12 14:50:46,852 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742083_1259
2015-02-12 14:50:49,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:49,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:49,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:49,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:49,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:50,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:50,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:50,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:50,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:50,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:50,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:50,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:50:50,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:50:50,751 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:50,753 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000003
2015-02-12 14:50:50,753 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000003
2015-02-12 14:50:50,753 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:50:50,753 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000003
2015-02-12 14:50:50,774 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:50:50,774 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 2074 Total time for transactions(ms): 187 Number of transactions batched in Syncs: 9 Number of syncs: 1432 SyncTimes(ms): 474 360
2015-02-12 14:50:50,780 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000003 is : 143
2015-02-12 14:50:50,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260 src: /127.0.0.1:53216 dest: /127.0.0.1:50543
2015-02-12 14:50:50,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260 src: /127.0.0.1:53217 dest: /127.0.0.1:50546
2015-02-12 14:50:50,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260 src: /127.0.0.1:53218 dest: /127.0.0.1:50539
2015-02-12 14:50:50,795 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:50,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000003
2015-02-12 14:50:50,796 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000003
2015-02-12 14:50:50,796 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000003
2015-02-12 14:50:50,796 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000003
2015-02-12 14:50:50,796 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:50,796 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000003 from application application_1423780884992_0023
2015-02-12 14:50:50,797 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:50,797 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:50,797 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000003
2015-02-12 14:50:50,799 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist for DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:50,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:50,906 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:50,908 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000002
2015-02-12 14:50:50,908 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000002
2015-02-12 14:50:50,909 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:50:50,909 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:50,910 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:50:50,910 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000003
2015-02-12 14:50:50,910 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:50:50,910 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000003 on node: host: 10.1.1.67:50571 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:50:50,912 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000002
2015-02-12 14:50:50,944 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000002 is : 143
2015-02-12 14:50:50,963 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:50,963 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000002
2015-02-12 14:50:50,964 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000002
2015-02-12 14:50:50,964 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000002
2015-02-12 14:50:50,964 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000002
2015-02-12 14:50:50,965 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000002
2015-02-12 14:50:50,966 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:50,966 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000002 from application application_1423780884992_0023
2015-02-12 14:50:50,966 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:50,966 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:51,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:50:51,183 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:51,185 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000006
2015-02-12 14:50:51,185 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000006
2015-02-12 14:50:51,185 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:50:51,185 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000006
2015-02-12 14:50:51,204 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000006 is : 143
2015-02-12 14:50:51,214 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:51,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000006
2015-02-12 14:50:51,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000006
2015-02-12 14:50:51,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000006
2015-02-12 14:50:51,216 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000006
2015-02-12 14:50:51,216 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000006
2015-02-12 14:50:51,220 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:51,221 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000006 from application application_1423780884992_0023
2015-02-12 14:50:51,221 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:51,221 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:51,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:50:51,268 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:51,270 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000004
2015-02-12 14:50:51,270 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000004
2015-02-12 14:50:51,270 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:50:51,270 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000004
2015-02-12 14:50:51,292 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000004 is : 143
2015-02-12 14:50:51,301 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:51,302 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000004
2015-02-12 14:50:51,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000004
2015-02-12 14:50:51,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000004
2015-02-12 14:50:51,306 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000004
2015-02-12 14:50:51,322 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000004
2015-02-12 14:50:51,323 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:51,324 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000004 from application application_1423780884992_0023
2015-02-12 14:50:51,324 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:51,324 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:51,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:50:51,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:50:51,351 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:51,353 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000005
2015-02-12 14:50:51,353 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000005
2015-02-12 14:50:51,353 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:50:51,353 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000005
2015-02-12 14:50:51,373 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:51,381 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000008
2015-02-12 14:50:51,381 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000008
2015-02-12 14:50:51,387 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000005 is : 143
2015-02-12 14:50:51,387 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:51,387 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:50:51,388 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000004
2015-02-12 14:50:51,388 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:50:51,388 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000004 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:50:51,413 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:50:51,413 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:51,414 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000008
2015-02-12 14:50:51,414 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000005
2015-02-12 14:50:51,414 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000005
2015-02-12 14:50:51,415 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000005
2015-02-12 14:50:51,415 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000005
2015-02-12 14:50:51,415 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000005
2015-02-12 14:50:51,415 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:51,416 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000005 from application application_1423780884992_0023
2015-02-12 14:50:51,416 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:51,416 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:51,436 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000008 is : 143
2015-02-12 14:50:51,445 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:51,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000008
2015-02-12 14:50:51,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000008
2015-02-12 14:50:51,447 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000008
2015-02-12 14:50:51,447 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000008
2015-02-12 14:50:51,449 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000008
2015-02-12 14:50:51,449 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:51,449 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000008 from application application_1423780884992_0023
2015-02-12 14:50:51,450 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:51,450 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:51,912 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:51,912 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:50:51,912 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000002
2015-02-12 14:50:51,912 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:51,913 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000002 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:51,913 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:52,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:52,191 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:50:52,191 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000006
2015-02-12 14:50:52,191 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:52,191 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000006 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:52,358 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:52,358 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:50:52,358 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000005
2015-02-12 14:50:52,358 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:52,358 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:52,390 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:52,390 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:52,390 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:50:52,391 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000008
2015-02-12 14:50:52,391 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:50:52,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000008 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:50:52,917 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000003]
2015-02-12 14:50:52,917 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:52,917 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:52,917 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:52,917 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000010
2015-02-12 14:50:52,917 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0023_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:50:53,196 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:53,362 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:53,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000004]
2015-02-12 14:50:53,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:53,391 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:53,483 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:53,494 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:53,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0023_01_000010 by user soberoi
2015-02-12 14:50:53,496 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000010
2015-02-12 14:50:53,496 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0023_01_000010 to application application_1423780884992_0023
2015-02-12 14:50:53,496 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 14:50:53,497 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0023
2015-02-12 14:50:53,497 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0023
2015-02-12 14:50:53,497 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:50:53,497 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0023
2015-02-12 14:50:53,497 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:53,528 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:53,528 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:53,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000010/default_container_executor.sh]
2015-02-12 14:50:53,922 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000002]
2015-02-12 14:50:53,922 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:53,922 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:54,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000006]
2015-02-12 14:50:54,201 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:54,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000005]
2015-02-12 14:50:54,365 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:54,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000008]
2015-02-12 14:50:54,396 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:54,490 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:50:56,097 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:56,101 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:56,104 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:56,107 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:56,112 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:50:56,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,398 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:50:56,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261 src: /127.0.0.1:53233 dest: /127.0.0.1:50543
2015-02-12 14:50:56,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261 src: /127.0.0.1:53234 dest: /127.0.0.1:50539
2015-02-12 14:50:56,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261 src: /127.0.0.1:53235 dest: /127.0.0.1:50549
2015-02-12 14:50:56,532 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53235, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0023_r_000000_0_927772611_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261, duration: 31348000
2015-02-12 14:50:56,532 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:56,534 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53234, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0023_r_000000_0_927772611_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261, duration: 32648000
2015-02-12 14:50:56,534 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,535 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53233, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0023_r_000000_0_927772611_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261, duration: 34586000
2015-02-12 14:50:56,535 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,536 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,537 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,537 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,541 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0023_r_000000_0_927772611_1
2015-02-12 14:50:56,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:56,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:50:56,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/task_1423780884992_0023_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:56,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/_temporary/attempt_1423780884992_0023_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/task_1423780884992_0023_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:50:56,581 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:50:56,584 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000010
2015-02-12 14:50:56,584 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000010
2015-02-12 14:50:56,585 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000010 transitioned from RUNNING to KILLING
2015-02-12 14:50:56,585 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000010
2015-02-12 14:50:56,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,609 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,613 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0023_01_000010 is : 143
2015-02-12 14:50:56,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:50:56,622 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:50:56,622 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000010
2015-02-12 14:50:56,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000010
2015-02-12 14:50:56,624 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000010
2015-02-12 14:50:56,623 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000010
2015-02-12 14:50:56,624 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:50:56,624 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000010 from application application_1423780884992_0023
2015-02-12 14:50:56,624 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:56,625 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:50:56,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:56,624 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000010
2015-02-12 14:50:56,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:56,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/task_1423780884992_0023_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:50:56,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:56,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary/1/task_1423780884992_0023_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary dst=null perm=null proto=rpc
2015-02-12 14:50:56,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,653 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,658 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,677 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53218, dest: /127.0.0.1:50539, bytes: 75536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260, duration: 5890268000
2015-02-12 14:50:56,677 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:56,683 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 17026
2015-02-12 14:50:56,684 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53217, dest: /127.0.0.1:50546, bytes: 75536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260, duration: 5892005000
2015-02-12 14:50:56,684 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,687 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53216, dest: /127.0.0.1:50543, bytes: 75536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260, duration: 5896265000
2015-02-12 14:50:56,687 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 17026
2015-02-12 14:50:56,688 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742084_1260, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,690 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 17026
2015-02-12 14:50:56,693 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,699 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:56,705 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262 src: /127.0.0.1:53237 dest: /127.0.0.1:50546
2015-02-12 14:50:56,707 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262 src: /127.0.0.1:53238 dest: /127.0.0.1:50549
2015-02-12 14:50:56,708 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262 src: /127.0.0.1:53239 dest: /127.0.0.1:50543
2015-02-12 14:50:56,712 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53239, dest: /127.0.0.1:50543, bytes: 461, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262, duration: 1690000
2015-02-12 14:50:56,712 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:56,712 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,713 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53238, dest: /127.0.0.1:50549, bytes: 461, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262, duration: 2313000
2015-02-12 14:50:56,713 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,714 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53237, dest: /127.0.0.1:50546, bytes: 461, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262, duration: 3755000
2015-02-12 14:50:56,714 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,714 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,715 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,716 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary_tmp is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:56,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:56,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:56,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:56,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:56,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:50:56,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,749 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:50:56,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263 src: /127.0.0.1:53241 dest: /127.0.0.1:50539
2015-02-12 14:50:56,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263 src: /127.0.0.1:53242 dest: /127.0.0.1:50549
2015-02-12 14:50:56,756 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263 src: /127.0.0.1:53243 dest: /127.0.0.1:50546
2015-02-12 14:50:56,760 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53243, dest: /127.0.0.1:50546, bytes: 75536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263, duration: 2040000
2015-02-12 14:50:56,760 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:56,761 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53242, dest: /127.0.0.1:50549, bytes: 75536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263, duration: 2697000
2015-02-12 14:50:56,761 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:56,761 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,762 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53241, dest: /127.0.0.1:50539, bytes: 75536, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263, duration: 3878000
2015-02-12 14:50:56,762 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:56,764 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:56,765 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:56,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:56,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:56,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:56,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:50:56,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023/job_1423780884992_0023_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:50:56,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:50:56,783 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:50:56,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264 src: /127.0.0.1:53246 dest: /127.0.0.1:50546
2015-02-12 14:50:56,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264 src: /127.0.0.1:53247 dest: /127.0.0.1:50539
2015-02-12 14:50:56,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264 src: /127.0.0.1:53248 dest: /127.0.0.1:50543
2015-02-12 14:50:56,794 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53248, dest: /127.0.0.1:50543, bytes: 114307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264, duration: 3864000
2015-02-12 14:50:56,794 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:56,795 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,796 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53247, dest: /127.0.0.1:50539, bytes: 114307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264, duration: 5438000
2015-02-12 14:50:56,796 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,797 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:50:56,797 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53246, dest: /127.0.0.1:50546, bytes: 114307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1201540933_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264, duration: 7222000
2015-02-12 14:50:56,797 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:56,798 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:56,800 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1201540933_1
2015-02-12 14:50:56,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:56,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:56,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:56,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:50:56,818 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0023_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:50:56,818 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:56,818 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0023 with final state: FINISHING
2015-02-12 14:50:56,818 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from RUNNING to FINAL_SAVING
2015-02-12 14:50:56,818 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0023
2015-02-12 14:50:56,818 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:56,818 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from FINAL_SAVING to FINISHING
2015-02-12 14:50:57,590 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:50:57,590 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 14:50:57,590 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000010
2015-02-12 14:50:57,591 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:50:57,591 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000010 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:50:57,822 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0023 unregistered successfully.
2015-02-12 14:50:57,826 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742078_1254 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:50:57,826 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742079_1255 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:50:57,826 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742080_1256 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:50:57,826 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742081_1257 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:50:57,827 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742083_1259 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:50:57,827 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742084_1260 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:50:57,827 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742082_1258 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:50:57,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0023 dst=null perm=null proto=rpc
2015-02-12 14:50:57,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,860 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary
2015-02-12 14:50:57,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/_temporary dst=null perm=null proto=rpc
2015-02-12 14:50:57,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,875 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:57,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:57,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,897 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:57,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:57,901 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields
2015-02-12 14:50:57,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields dst=null perm=null proto=rpc
2015-02-12 14:50:57,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:57,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/samefiledifffields/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:50:57,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:57,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:57,927 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:50:57,927 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:50:57,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner"]
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:50:57,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:50:57,954 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...latform/cogroupouterinner
2015-02-12 14:50:57,964 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:50:57,975 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:50:57,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:50:57,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:57,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:50:57,983 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 24
2015-02-12 14:50:57,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024 dst=null perm=null proto=rpc
2015-02-12 14:50:57,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:50:57,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:50:57,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:57,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:57,993 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:50:57,996 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 src: /127.0.0.1:53253 dest: /127.0.0.1:50543
2015-02-12 14:50:57,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 src: /127.0.0.1:53254 dest: /127.0.0.1:50546
2015-02-12 14:50:57,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 src: /127.0.0.1:53255 dest: /127.0.0.1:50539
2015-02-12 14:50:58,005 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53255, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265, duration: 3884000
2015-02-12 14:50:58,005 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:58,006 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:50:58,006 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53254, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265, duration: 2586000
2015-02-12 14:50:58,007 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,007 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,008 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53253, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265, duration: 4641000
2015-02-12 14:50:58,008 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,009 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,011 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:58,012 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar
2015-02-12 14:50:58,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:50:58,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:50:58,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:50:58,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:50:58,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:50:58,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,022 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:58,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,025 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:58,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,027 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:58,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,029 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:50:58,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:50:58,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,034 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split
2015-02-12 14:50:58,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:58,037 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:50:58,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266 src: /127.0.0.1:53256 dest: /127.0.0.1:50543
2015-02-12 14:50:58,040 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266 src: /127.0.0.1:53257 dest: /127.0.0.1:50546
2015-02-12 14:50:58,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266 src: /127.0.0.1:53258 dest: /127.0.0.1:50549
2015-02-12 14:50:58,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266 src: /127.0.0.1:53259 dest: /127.0.0.1:50539
2015-02-12 14:50:58,049 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53259, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, duration: 3341000
2015-02-12 14:50:58,050 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:58,050 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:50:58,050 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53258, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, duration: 3664000
2015-02-12 14:50:58,051 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,051 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53257, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, duration: 3608000
2015-02-12 14:50:58,052 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,052 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,053 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,053 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53256, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, duration: 4913000
2015-02-12 14:50:58,053 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,055 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,057 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:58,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,062 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:50:58,063 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267 src: /127.0.0.1:53260 dest: /127.0.0.1:50546
2015-02-12 14:50:58,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267 src: /127.0.0.1:53261 dest: /127.0.0.1:50539
2015-02-12 14:50:58,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267 src: /127.0.0.1:53262 dest: /127.0.0.1:50543
2015-02-12 14:50:58,069 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53262, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267, duration: 1203000
2015-02-12 14:50:58,069 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:58,070 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:58,070 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53261, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267, duration: 2001000
2015-02-12 14:50:58,071 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,071 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53260, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267, duration: 3299000
2015-02-12 14:50:58,072 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,072 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:58,074 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:50:58,075 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:58,075 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:50:58,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:50:58,083 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:50:58,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268 src: /127.0.0.1:53263 dest: /127.0.0.1:50539
2015-02-12 14:50:58,086 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268 src: /127.0.0.1:53264 dest: /127.0.0.1:50546
2015-02-12 14:50:58,087 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268 src: /127.0.0.1:53265 dest: /127.0.0.1:50549
2015-02-12 14:50:58,090 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53265, dest: /127.0.0.1:50549, bytes: 97923, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268, duration: 1646000
2015-02-12 14:50:58,090 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:50:58,091 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,091 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53264, dest: /127.0.0.1:50546, bytes: 97923, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268, duration: 2364000
2015-02-12 14:50:58,091 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,091 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,092 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53263, dest: /127.0.0.1:50539, bytes: 97923, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268, duration: 2921000
2015-02-12 14:50:58,092 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:50:58,093 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:50:58,093 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742089_1265 to datanode(s) 127.0.0.1:50549
2015-02-12 14:50:58,094 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742080_1256, blk_1073742082_1258, blk_1073742083_1259, blk_1073742084_1260, blk_1073742078_1254, blk_1073742079_1255]
2015-02-12 14:50:58,094 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:50:58,094 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259, blk_1073742078_1254, blk_1073742079_1255]
2015-02-12 14:50:58,094 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0024
2015-02-12 14:50:58,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024 dst=null perm=null proto=rpc
2015-02-12 14:50:58,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:58,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:58,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:58,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:58,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:58,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:58,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,114 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 24 submitted by user soberoi
2015-02-12 14:50:58,114 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0024
2015-02-12 14:50:58,114 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0024
2015-02-12 14:50:58,114 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0024
2015-02-12 14:50:58,114 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from NEW to NEW_SAVING
2015-02-12 14:50:58,115 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:50:58,115 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0024 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:50:58,115 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from SUBMITTED to ACCEPTED
2015-02-12 14:50:58,116 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0024
2015-02-12 14:50:58,116 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0024_000001
2015-02-12 14:50:58,116 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from NEW to SUBMITTED
2015-02-12 14:50:58,116 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0024_000001 to scheduler from user: soberoi
2015-02-12 14:50:58,116 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:50:58,122 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0024/
2015-02-12 14:50:58,122 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0024
2015-02-12 14:50:58,122 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0024/
2015-02-12 14:50:58,210 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:50:58,211 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000001
2015-02-12 14:50:58,211 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:50:58,212 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0024_01_000001
2015-02-12 14:50:58,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:50:58,212 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0024_000001
2015-02-12 14:50:58,212 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0024 AttemptId: appattempt_1423780884992_0024_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0024_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:50:58,213 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:50:58,213 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:50:58,213 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0024_000001
2015-02-12 14:50:58,214 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0024_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0024_000001
2015-02-12 14:50:58,215 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0024_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:50:58,215 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0024_000001
2015-02-12 14:50:58,215 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0024_000001
2015-02-12 14:50:58,218 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:50:58,222 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000001 by user soberoi
2015-02-12 14:50:58,222 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0024
2015-02-12 14:50:58,222 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000001
2015-02-12 14:50:58,222 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from NEW to INITING
2015-02-12 14:50:58,222 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000001 to application application_1423780884992_0024
2015-02-12 14:50:58,222 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from INITING to RUNNING
2015-02-12 14:50:58,222 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0024_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0024_000001
2015-02-12 14:50:58,223 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:50:58,223 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:50:58,223 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:50:58,223 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:50:58,223 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:50:58,223 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:50:58,224 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:50:58,224 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0024_01_000001
2015-02-12 14:50:58,234 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0024_01_000001.tokens. Credentials list:
2015-02-12 14:50:58,341 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:50:58,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0024_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000001.tokens
2015-02-12 14:50:58,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:50:58,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:50:58,553 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0024/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:58,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:58,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:50:58,592 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:50:58,618 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:58,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:58,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:50:58,684 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0024/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:58,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:58,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:50:58,749 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0024/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:50:58,749 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:50:58,789 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:50:58,790 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:50:58,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000001/default_container_executor.sh]
2015-02-12 14:50:58,949 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 to 127.0.0.1:50549
2015-02-12 14:50:58,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742080_1256 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742080 for deletion
2015-02-12 14:50:58,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742082 for deletion
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742083 for deletion
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742084 for deletion
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078 for deletion
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079 for deletion
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742080_1256 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742080
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742082
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742083
2015-02-12 14:50:58,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742084
2015-02-12 14:50:58,951 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078
2015-02-12 14:50:58,951 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079
2015-02-12 14:50:58,952 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:50:58,953 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 src: /127.0.0.1:53270 dest: /127.0.0.1:50549
2015-02-12 14:50:58,955 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265 src: /127.0.0.1:53270 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:50:58,956 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742089_1265 size 254067
2015-02-12 14:50:59,210 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:50:59,534 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742081 for deletion
2015-02-12 14:50:59,534 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742082 for deletion
2015-02-12 14:50:59,534 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742083 for deletion
2015-02-12 14:50:59,534 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078 for deletion
2015-02-12 14:50:59,535 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079 for deletion
2015-02-12 14:50:59,534 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742081
2015-02-12 14:50:59,535 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742082
2015-02-12 14:50:59,535 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742083
2015-02-12 14:50:59,535 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079
2015-02-12 14:50:59,536 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078
2015-02-12 14:50:59,593 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:00,597 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:01,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:01,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:51:01,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:51:01,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:51:01,095 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742080_1256, blk_1073742081_1257, blk_1073742083_1259, blk_1073742084_1260, blk_1073742078_1254, blk_1073742079_1255]
2015-02-12 14:51:01,095 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742080_1256, blk_1073742081_1257, blk_1073742082_1258, blk_1073742084_1260, blk_1073742078_1254, blk_1073742079_1255]
2015-02-12 14:51:01,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024 dst=null perm=null proto=rpc
2015-02-12 14:51:01,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:51:01,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:51:01,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:01,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:01,601 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:01,868 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263
2015-02-12 14:51:01,869 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262
2015-02-12 14:51:01,869 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261
2015-02-12 14:51:01,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742080_1256 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742080 for deletion
2015-02-12 14:51:01,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742081 for deletion
2015-02-12 14:51:01,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742083 for deletion
2015-02-12 14:51:01,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742080_1256 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742080
2015-02-12 14:51:01,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742081
2015-02-12 14:51:01,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742084 for deletion
2015-02-12 14:51:01,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078 for deletion
2015-02-12 14:51:01,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079 for deletion
2015-02-12 14:51:01,951 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742083
2015-02-12 14:51:01,951 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742084
2015-02-12 14:51:01,951 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079
2015-02-12 14:51:01,952 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078
2015-02-12 14:51:02,285 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742080_1256 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742080 for deletion
2015-02-12 14:51:02,285 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742081 for deletion
2015-02-12 14:51:02,285 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742082 for deletion
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742084 for deletion
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078 for deletion
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742080_1256 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742080
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079 for deletion
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742081
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742082
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742084
2015-02-12 14:51:02,286 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742078
2015-02-12 14:51:02,287 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742079_1255 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742079
2015-02-12 14:51:02,402 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:02,405 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0024_000001
2015-02-12 14:51:02,405 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0024 APPATTEMPTID=appattempt_1423780884992_0024_000001
2015-02-12 14:51:02,405 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:51:02,405 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from ACCEPTED to RUNNING
2015-02-12 14:51:02,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:02,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:51:02,603 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:02,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:02,838 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:51:02,880 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0023_01_000001 succeeded
2015-02-12 14:51:02,881 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:51:02,881 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0023_01_000001
2015-02-12 14:51:02,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269 src: /127.0.0.1:53279 dest: /127.0.0.1:50546
2015-02-12 14:51:02,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269 src: /127.0.0.1:53280 dest: /127.0.0.1:50549
2015-02-12 14:51:02,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269 src: /127.0.0.1:53281 dest: /127.0.0.1:50539
2015-02-12 14:51:02,905 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000001
2015-02-12 14:51:02,905 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0023_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:51:02,905 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0023_01_000001 from application application_1423780884992_0023
2015-02-12 14:51:02,905 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:02,905 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0023
2015-02-12 14:51:02,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000001
2015-02-12 14:51:02,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000001
2015-02-12 14:51:02,904 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000001
2015-02-12 14:51:02,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023/container_1423780884992_0023_01_000001
2015-02-12 14:51:02,949 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53281, dest: /127.0.0.1:50539, bytes: 114638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269, duration: 40789000
2015-02-12 14:51:02,950 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:02,950 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:02,950 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53280, dest: /127.0.0.1:50549, bytes: 114638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269, duration: 40157000
2015-02-12 14:51:02,950 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:02,951 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53279, dest: /127.0.0.1:50546, bytes: 114638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269, duration: 41364000
2015-02-12 14:51:02,951 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:02,951 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:02,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:02,959 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:02,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:02,997 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:51:03,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270 src: /127.0.0.1:53282 dest: /127.0.0.1:50546
2015-02-12 14:51:03,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270 src: /127.0.0.1:53283 dest: /127.0.0.1:50549
2015-02-12 14:51:03,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270 src: /127.0.0.1:53284 dest: /127.0.0.1:50543
2015-02-12 14:51:03,007 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53284, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270, duration: 1661000
2015-02-12 14:51:03,007 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:03,007 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:03,007 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53283, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270, duration: 2220000
2015-02-12 14:51:03,008 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:03,009 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53282, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270, duration: 3399000
2015-02-12 14:51:03,009 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:03,009 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:03,010 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:03,012 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024.summary is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:03,606 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0023_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:03,606 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0023_000001
2015-02-12 14:51:03,606 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0023_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:51:03,606 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000001
2015-02-12 14:51:03,606 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0023_000001
2015-02-12 14:51:03,606 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0023_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:03,607 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0023_000001 State change from FINISHING to FINISHED
2015-02-12 14:51:03,607 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0023_000001 released container container_1423780884992_0023_01_000001 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:03,607 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:03,607 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0023 State change from FINISHING to FINISHED
2015-02-12 14:51:03,608 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:03,608 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000002
2015-02-12 14:51:03,608 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0023_000001
2015-02-12 14:51:03,608 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:03,609 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0023_000001 is done. finalState=FINISHED
2015-02-12 14:51:03,609 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0023 requests cleared
2015-02-12 14:51:03,608 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0023
2015-02-12 14:51:03,609 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0023,name=[D54F92D3C1B64EA6AE805D32E84412C6/C5F38FB507F2477DB7622E2291A629DC] offsetLower*lower/(1/1) ...atform/samefiledifffields,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0023/jobhistory/job/job_1423780884992_0023,appMasterHost=10.1.1.67,startTime=1423781432070,finishTime=1423781456818,finalStatus=SUCCEEDED
2015-02-12 14:51:03,611 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0023_000001 (auth:SIMPLE)
2015-02-12 14:51:03,613 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0023_01_000001
2015-02-12 14:51:03,613 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0023 CONTAINERID=container_1423780884992_0023_01_000001
2015-02-12 14:51:03,613 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0023_01_000001]
2015-02-12 14:51:03,613 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:03,613 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:03,614 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:03,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:03,614 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:03,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:03,615 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:03,616 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:03,616 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0023
2015-02-12 14:51:03,614 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000003
2015-02-12 14:51:03,616 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:51:03,616 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:03,617 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0023, with delay of 10800 seconds
2015-02-12 14:51:04,225 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:04,225 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:04,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,225 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000004
2015-02-12 14:51:04,226 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:51:04,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,226 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0023
2015-02-12 14:51:04,227 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:04,227 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0023, with delay of 10800 seconds
2015-02-12 14:51:04,227 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,227 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,394 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:04,394 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:04,394 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000005
2015-02-12 14:51:04,394 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:04,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,395 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0023
2015-02-12 14:51:04,396 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:04,396 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0023, with delay of 10800 seconds
2015-02-12 14:51:04,396 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,396 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,420 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:04,420 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:04,420 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000006
2015-02-12 14:51:04,420 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:04,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0023
2015-02-12 14:51:04,422 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0023
2015-02-12 14:51:04,423 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:04,423 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0023, with delay of 10800 seconds
2015-02-12 14:51:04,521 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0024_01_000002
2015-02-12 14:51:04,522 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:04,522 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:04,522 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0024_01_000004
2015-02-12 14:51:04,523 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:04,523 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0024_01_000005
2015-02-12 14:51:04,523 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:04,524 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0024_01_000006
2015-02-12 14:51:04,524 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:04,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:04,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:04,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:04,616 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:04,672 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:04,673 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:04,673 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:04,674 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:04,675 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:04,678 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000002 by user soberoi
2015-02-12 14:51:04,678 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0024
2015-02-12 14:51:04,678 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000002
2015-02-12 14:51:04,679 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from NEW to INITING
2015-02-12 14:51:04,679 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000002 to application application_1423780884992_0024
2015-02-12 14:51:04,679 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from INITING to RUNNING
2015-02-12 14:51:04,680 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:51:04,680 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,680 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,680 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:04,680 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0024
2015-02-12 14:51:04,680 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:04,680 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:04,680 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0024_01_000002
2015-02-12 14:51:04,681 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000003 by user soberoi
2015-02-12 14:51:04,682 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000003
2015-02-12 14:51:04,682 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000003 to application application_1423780884992_0024
2015-02-12 14:51:04,682 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000006 by user soberoi
2015-02-12 14:51:04,683 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0024
2015-02-12 14:51:04,683 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000006
2015-02-12 14:51:04,682 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:51:04,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,683 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,683 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:04,683 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0024
2015-02-12 14:51:04,684 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000005 by user soberoi
2015-02-12 14:51:04,684 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000004 by user soberoi
2015-02-12 14:51:04,684 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000004
2015-02-12 14:51:04,684 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from NEW to INITING
2015-02-12 14:51:04,684 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000006 to application application_1423780884992_0024
2015-02-12 14:51:04,684 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from INITING to RUNNING
2015-02-12 14:51:04,685 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:51:04,685 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,685 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,685 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:04,685 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0024
2015-02-12 14:51:04,685 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:04,685 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:04,685 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0024_01_000006
2015-02-12 14:51:04,684 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0024_01_000003
2015-02-12 14:51:04,686 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000004 to application application_1423780884992_0024
2015-02-12 14:51:04,686 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:51:04,686 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,686 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,686 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:04,686 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0024
2015-02-12 14:51:04,687 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:04,684 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0024
2015-02-12 14:51:04,687 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000005
2015-02-12 14:51:04,688 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from NEW to INITING
2015-02-12 14:51:04,688 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000005 to application application_1423780884992_0024
2015-02-12 14:51:04,688 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from INITING to RUNNING
2015-02-12 14:51:04,693 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:51:04,694 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,694 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0024
2015-02-12 14:51:04,694 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:04,694 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0024
2015-02-12 14:51:04,694 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:04,694 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:04,694 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0024_01_000005
2015-02-12 14:51:04,716 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0024_01_000002.tokens. Credentials list:
2015-02-12 14:51:04,718 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0024_01_000006.tokens. Credentials list:
2015-02-12 14:51:04,725 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0024_01_000003.tokens. Credentials list:
2015-02-12 14:51:04,725 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0024_01_000005.tokens. Credentials list:
2015-02-12 14:51:04,803 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:04,803 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:04,946 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:04,949 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:04,959 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:05,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000004/default_container_executor.sh]
2015-02-12 14:51:05,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0024_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000006.tokens
2015-02-12 14:51:05,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:05,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0024_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000005.tokens
2015-02-12 14:51:05,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:05,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0024_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000002.tokens
2015-02-12 14:51:05,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:05,225 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:05,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:05,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:05,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:05,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:05,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:05,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:05,395 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:05,420 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:05,428 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0024/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:05,430 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0024/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:05,433 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0024/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:05,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:05,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:05,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:05,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:05,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:05,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:05,528 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:05,528 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:05,529 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:05,535 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:51:05,540 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0024/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:05,540 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0024/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:05,540 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:05,541 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:05,589 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267
2015-02-12 14:51:05,590 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268
2015-02-12 14:51:05,591 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265
2015-02-12 14:51:05,611 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:05,611 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:05,612 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:05,612 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:05,617 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:05,618 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:05,620 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:05,621 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:05,622 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:05,622 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:05,627 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265
2015-02-12 14:51:05,627 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266
2015-02-12 14:51:05,628 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262
2015-02-12 14:51:05,791 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264
2015-02-12 14:51:05,791 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261
2015-02-12 14:51:05,792 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263
2015-02-12 14:51:05,793 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266
2015-02-12 14:51:05,827 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264
2015-02-12 14:51:05,827 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267
2015-02-12 14:51:05,828 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742085_1261
2015-02-12 14:51:05,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000003/default_container_executor.sh]
2015-02-12 14:51:05,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000005/default_container_executor.sh]
2015-02-12 14:51:05,843 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000002/default_container_executor.sh]
2015-02-12 14:51:05,862 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000006/default_container_executor.sh]
2015-02-12 14:51:06,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742088_1264
2015-02-12 14:51:06,046 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742086_1262
2015-02-12 14:51:06,046 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742087_1263
2015-02-12 14:51:06,047 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742091_1267
2015-02-12 14:51:06,048 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266
2015-02-12 14:51:06,446 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265
2015-02-12 14:51:06,447 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268
2015-02-12 14:51:06,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:06,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0024_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000003.tokens
2015-02-12 14:51:06,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:06,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742089_1265
2015-02-12 14:51:06,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742090_1266
2015-02-12 14:51:06,876 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742092_1268
2015-02-12 14:51:09,586 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:51:09,586 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:51:10,798 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269
2015-02-12 14:51:10,832 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270
2015-02-12 14:51:11,450 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270
2015-02-12 14:51:11,451 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269
2015-02-12 14:51:11,879 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742094_1270
2015-02-12 14:51:11,880 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742093_1269
2015-02-12 14:51:12,415 INFO scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:run(430)) - Release request cache is cleaned up
2015-02-12 14:51:14,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:14,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:14,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:14,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:14,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:14,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:14,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:14,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:14,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:15,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:15,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:51:15,454 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:15,457 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000004
2015-02-12 14:51:15,457 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000004
2015-02-12 14:51:15,457 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:51:15,457 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000004
2015-02-12 14:51:15,480 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0024_01_000004 is : 143
2015-02-12 14:51:15,480 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:51:15,483 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271 src: /127.0.0.1:53333 dest: /127.0.0.1:50549
2015-02-12 14:51:15,485 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271 src: /127.0.0.1:53334 dest: /127.0.0.1:50539
2015-02-12 14:51:15,488 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271 src: /127.0.0.1:53335 dest: /127.0.0.1:50543
2015-02-12 14:51:15,501 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:15,502 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000004
2015-02-12 14:51:15,502 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000004
2015-02-12 14:51:15,523 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist for DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:15,523 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000004
2015-02-12 14:51:15,523 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000004
2015-02-12 14:51:15,526 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000004
2015-02-12 14:51:15,527 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:15,527 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000004 from application application_1423780884992_0024
2015-02-12 14:51:15,527 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:15,528 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:15,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:51:15,665 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:15,668 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000002
2015-02-12 14:51:15,668 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000002
2015-02-12 14:51:15,668 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:51:15,668 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000002
2015-02-12 14:51:15,703 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0024_01_000002 is : 143
2015-02-12 14:51:15,712 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:15,713 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000002
2015-02-12 14:51:15,713 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000002
2015-02-12 14:51:15,713 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000002
2015-02-12 14:51:15,714 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000002
2015-02-12 14:51:15,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000002
2015-02-12 14:51:15,714 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:15,714 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000002 from application application_1423780884992_0024
2015-02-12 14:51:15,714 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:15,715 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:15,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:51:15,758 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:15,762 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000003
2015-02-12 14:51:15,762 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000003
2015-02-12 14:51:15,764 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:15,764 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:51:15,764 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000002
2015-02-12 14:51:15,765 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:51:15,765 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000002 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:51:15,764 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:51:15,766 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000003
2015-02-12 14:51:15,790 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0024_01_000003 is : 143
2015-02-12 14:51:15,800 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:15,801 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000003
2015-02-12 14:51:15,801 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000003
2015-02-12 14:51:15,801 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000003
2015-02-12 14:51:15,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000003
2015-02-12 14:51:15,802 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000003
2015-02-12 14:51:15,803 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:15,803 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000003 from application application_1423780884992_0024
2015-02-12 14:51:15,803 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:15,803 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:15,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:51:15,858 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:15,860 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000005
2015-02-12 14:51:15,860 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000005
2015-02-12 14:51:15,860 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:51:15,860 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000005
2015-02-12 14:51:15,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:51:15,883 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0024_01_000005 is : 143
2015-02-12 14:51:15,897 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:15,897 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000005
2015-02-12 14:51:15,898 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000005
2015-02-12 14:51:15,898 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000005
2015-02-12 14:51:15,898 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000005
2015-02-12 14:51:15,898 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000005
2015-02-12 14:51:15,899 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:15,899 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000005 from application application_1423780884992_0024
2015-02-12 14:51:15,899 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:15,900 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:15,914 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:15,916 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000006
2015-02-12 14:51:15,916 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000006
2015-02-12 14:51:15,916 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:51:15,916 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000006
2015-02-12 14:51:15,938 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0024_01_000006 is : 143
2015-02-12 14:51:15,949 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:15,951 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000006
2015-02-12 14:51:15,951 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:15,951 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000006 from application application_1423780884992_0024
2015-02-12 14:51:15,951 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:15,951 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:15,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000006
2015-02-12 14:51:15,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000006
2015-02-12 14:51:15,953 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000006
2015-02-12 14:51:15,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000006
2015-02-12 14:51:16,462 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:16,462 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:51:16,462 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000004
2015-02-12 14:51:16,463 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:51:16,463 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000004 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:51:16,765 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:16,765 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:16,765 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:51:16,765 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000003
2015-02-12 14:51:16,765 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:16,765 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000003 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:16,766 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:16,766 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000007
2015-02-12 14:51:16,766 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0024_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:16,864 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:16,864 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:51:16,864 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000005
2015-02-12 14:51:16,864 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:16,864 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:16,921 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:16,921 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:51:16,921 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000006
2015-02-12 14:51:16,921 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:16,921 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000006 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:17,464 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:17,591 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:17,602 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:17,604 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0024_01_000007 by user soberoi
2015-02-12 14:51:17,604 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000007
2015-02-12 14:51:17,604 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0024_01_000007 to application application_1423780884992_0024
2015-02-12 14:51:17,605 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:51:17,605 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0024
2015-02-12 14:51:17,605 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0024
2015-02-12 14:51:17,605 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:17,605 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0024
2015-02-12 14:51:17,606 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:17,634 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:17,634 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:17,745 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000007/default_container_executor.sh]
2015-02-12 14:51:17,766 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0024_01_000002]
2015-02-12 14:51:17,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:17,767 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:17,767 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:17,867 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:17,924 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:18,465 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0024_01_000004]
2015-02-12 14:51:18,465 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:18,597 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:51:18,769 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0024_01_000003]
2015-02-12 14:51:18,769 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:18,871 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0024_01_000005]
2015-02-12 14:51:18,871 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:18,926 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0024_01_000006]
2015-02-12 14:51:18,926 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:20,191 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:20,195 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:20,198 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:20,201 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:20,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,492 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:51:20,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272 src: /127.0.0.1:53349 dest: /127.0.0.1:50543
2015-02-12 14:51:20,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272 src: /127.0.0.1:53350 dest: /127.0.0.1:50549
2015-02-12 14:51:20,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272 src: /127.0.0.1:53351 dest: /127.0.0.1:50539
2015-02-12 14:51:20,629 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53351, dest: /127.0.0.1:50539, bytes: 172, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0024_r_000000_0_700655727_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272, duration: 36076000
2015-02-12 14:51:20,630 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:20,630 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,630 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53350, dest: /127.0.0.1:50549, bytes: 172, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0024_r_000000_0_700655727_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272, duration: 37095000
2015-02-12 14:51:20,631 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,631 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,631 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53349, dest: /127.0.0.1:50543, bytes: 172, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0024_r_000000_0_700655727_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272, duration: 38134000
2015-02-12 14:51:20,632 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,632 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,637 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0024_r_000000_0_700655727_1
2015-02-12 14:51:20,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:51:20,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:51:20,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/task_1423780884992_0024_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:51:20,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/_temporary/attempt_1423780884992_0024_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/task_1423780884992_0024_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:51:20,677 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:20,680 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000007
2015-02-12 14:51:20,680 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000007
2015-02-12 14:51:20,680 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:51:20,680 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000007
2015-02-12 14:51:20,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,700 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:51:20,709 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0024_01_000007 is : 143
2015-02-12 14:51:20,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:20,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:20,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/task_1423780884992_0024_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:51:20,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:20,724 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:20,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000007
2015-02-12 14:51:20,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000007
2015-02-12 14:51:20,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000007
2015-02-12 14:51:20,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000007
2015-02-12 14:51:20,729 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000007
2015-02-12 14:51:20,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary/1/task_1423780884992_0024_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,730 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:20,730 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000007 from application application_1423780884992_0024
2015-02-12 14:51:20,730 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:20,730 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:20,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary dst=null perm=null proto=rpc
2015-02-12 14:51:20,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,742 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,747 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,764 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53335, dest: /127.0.0.1:50543, bytes: 69200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271, duration: 5273727000
2015-02-12 14:51:20,764 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:20,765 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16374
2015-02-12 14:51:20,766 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53334, dest: /127.0.0.1:50539, bytes: 69200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271, duration: 5273368000
2015-02-12 14:51:20,766 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,768 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16374
2015-02-12 14:51:20,769 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53333, dest: /127.0.0.1:50549, bytes: 69200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271, duration: 5278157000
2015-02-12 14:51:20,769 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,770 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16374
2015-02-12 14:51:20,772 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,785 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:51:20,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273 src: /127.0.0.1:53353 dest: /127.0.0.1:50546
2015-02-12 14:51:20,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273 src: /127.0.0.1:53354 dest: /127.0.0.1:50539
2015-02-12 14:51:20,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273 src: /127.0.0.1:53355 dest: /127.0.0.1:50543
2015-02-12 14:51:20,811 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53355, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273, duration: 2244000
2015-02-12 14:51:20,811 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:20,812 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:51:20,812 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53354, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273, duration: 2372000
2015-02-12 14:51:20,812 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,812 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:51:20,813 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53353, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273, duration: 3675000
2015-02-12 14:51:20,813 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,813 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,815 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary_tmp is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:20,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:51:20,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:20,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:51:20,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:20,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:51:20,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,849 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:51:20,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274 src: /127.0.0.1:53357 dest: /127.0.0.1:50539
2015-02-12 14:51:20,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274 src: /127.0.0.1:53358 dest: /127.0.0.1:50546
2015-02-12 14:51:20,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274 src: /127.0.0.1:53359 dest: /127.0.0.1:50549
2015-02-12 14:51:20,858 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53359, dest: /127.0.0.1:50549, bytes: 69200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274, duration: 1857000
2015-02-12 14:51:20,858 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:20,859 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,859 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53358, dest: /127.0.0.1:50546, bytes: 69200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274, duration: 2185000
2015-02-12 14:51:20,859 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,860 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,860 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53357, dest: /127.0.0.1:50539, bytes: 69200, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274, duration: 3466000
2015-02-12 14:51:20,860 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,861 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,862 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:20,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:51:20,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:20,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:51:20,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:20,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024/job_1423780884992_0024_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:51:20,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:20,881 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:51:20,885 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275 src: /127.0.0.1:53361 dest: /127.0.0.1:50539
2015-02-12 14:51:20,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275 src: /127.0.0.1:53362 dest: /127.0.0.1:50549
2015-02-12 14:51:20,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275 src: /127.0.0.1:53363 dest: /127.0.0.1:50543
2015-02-12 14:51:20,895 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53363, dest: /127.0.0.1:50543, bytes: 114638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275, duration: 3373000
2015-02-12 14:51:20,896 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:20,897 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53362, dest: /127.0.0.1:50549, bytes: 114638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275, duration: 4934000
2015-02-12 14:51:20,898 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:51:20,898 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,899 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53361, dest: /127.0.0.1:50539, bytes: 114638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-699770624_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275, duration: 6708000
2015-02-12 14:51:20,899 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:51:20,899 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:20,900 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:20,901 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-699770624_1
2015-02-12 14:51:20,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:20,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:20,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:20,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:20,923 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0024_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:51:20,924 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:51:20,924 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0024 with final state: FINISHING
2015-02-12 14:51:20,925 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from RUNNING to FINAL_SAVING
2015-02-12 14:51:20,925 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0024
2015-02-12 14:51:20,925 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:51:20,925 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from FINAL_SAVING to FINISHING
2015-02-12 14:51:21,686 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:21,686 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:51:21,686 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000007
2015-02-12 14:51:21,686 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:21,686 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000007 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:21,933 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0024 unregistered successfully.
2015-02-12 14:51:21,936 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742089_1265 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:51:21,937 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742090_1266 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:51:21,937 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742091_1267 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:51:21,937 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742092_1268 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:51:21,937 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742094_1270 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:51:21,937 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742095_1271 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:51:21,938 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742093_1269 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:51:21,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0024 dst=null perm=null proto=rpc
2015-02-12 14:51:21,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:21,980 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary
2015-02-12 14:51:21,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/_temporary dst=null perm=null proto=rpc
2015-02-12 14:51:22,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:22,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:22,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:22,018 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:22,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:22,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:22,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:22,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:22,035 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:22,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:22,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,049 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:51:22,049 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:51:22,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:22,064 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:51:22,064 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:51:22,065 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:51:22,065 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup"]
2015-02-12 14:51:22,065 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:51:22,065 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:51:22,065 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:51:22,068 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...oupouterinner-resultgroup
2015-02-12 14:51:22,083 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:51:22,094 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:51:22,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:22,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:22,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:22,099 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 25
2015-02-12 14:51:22,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025 dst=null perm=null proto=rpc
2015-02-12 14:51:22,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:51:22,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:51:22,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,109 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:51:22,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 src: /127.0.0.1:53367 dest: /127.0.0.1:50549
2015-02-12 14:51:22,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 src: /127.0.0.1:53368 dest: /127.0.0.1:50546
2015-02-12 14:51:22,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 src: /127.0.0.1:53369 dest: /127.0.0.1:50543
2015-02-12 14:51:22,116 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742089_1265, blk_1073742090_1266, blk_1073742092_1268, blk_1073742093_1269, blk_1073742094_1270, blk_1073742095_1271]
2015-02-12 14:51:22,116 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742089_1265, blk_1073742090_1266, blk_1073742091_1267, blk_1073742092_1268, blk_1073742093_1269, blk_1073742094_1270]
2015-02-12 14:51:22,121 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53369, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276, duration: 3955000
2015-02-12 14:51:22,121 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:22,122 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,122 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53368, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276, duration: 4986000
2015-02-12 14:51:22,122 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,123 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,123 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53367, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276, duration: 5058000
2015-02-12 14:51:22,124 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,125 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,126 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:22,129 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar
2015-02-12 14:51:22,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:51:22,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:51:22,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:51:22,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:51:22,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:51:22,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,141 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:22,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,143 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:22,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,146 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:22,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,148 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:22,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:22,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,153 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split
2015-02-12 14:51:22,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:22,154 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:51:22,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277 src: /127.0.0.1:53370 dest: /127.0.0.1:50543
2015-02-12 14:51:22,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277 src: /127.0.0.1:53371 dest: /127.0.0.1:50549
2015-02-12 14:51:22,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277 src: /127.0.0.1:53372 dest: /127.0.0.1:50539
2015-02-12 14:51:22,161 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277 src: /127.0.0.1:53373 dest: /127.0.0.1:50546
2015-02-12 14:51:22,165 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53373, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, duration: 2355000
2015-02-12 14:51:22,166 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:22,166 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,167 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53372, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, duration: 3684000
2015-02-12 14:51:22,168 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,169 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,170 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53371, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, duration: 5624000
2015-02-12 14:51:22,170 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,171 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,171 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53370, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, duration: 7581000
2015-02-12 14:51:22,171 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,173 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,174 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:22,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,180 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:51:22,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278 src: /127.0.0.1:53374 dest: /127.0.0.1:50549
2015-02-12 14:51:22,184 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278 src: /127.0.0.1:53375 dest: /127.0.0.1:50539
2015-02-12 14:51:22,185 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278 src: /127.0.0.1:53376 dest: /127.0.0.1:50546
2015-02-12 14:51:22,188 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53376, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278, duration: 1189000
2015-02-12 14:51:22,188 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:22,188 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53375, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278, duration: 1910000
2015-02-12 14:51:22,189 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,188 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:51:22,190 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53374, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278, duration: 2951000
2015-02-12 14:51:22,190 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,191 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,193 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,196 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:22,196 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:51:22,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:22,208 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:51:22,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279 src: /127.0.0.1:53377 dest: /127.0.0.1:50539
2015-02-12 14:51:22,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279 src: /127.0.0.1:53378 dest: /127.0.0.1:50546
2015-02-12 14:51:22,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279 src: /127.0.0.1:53379 dest: /127.0.0.1:50543
2015-02-12 14:51:22,219 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53379, dest: /127.0.0.1:50543, bytes: 97943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279, duration: 3557000
2015-02-12 14:51:22,219 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:22,219 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,220 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53378, dest: /127.0.0.1:50546, bytes: 97943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279, duration: 4507000
2015-02-12 14:51:22,221 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,221 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53377, dest: /127.0.0.1:50539, bytes: 97943, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279, duration: 5610000
2015-02-12 14:51:22,221 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:22,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:22,228 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:22,229 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0025
2015-02-12 14:51:22,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025 dst=null perm=null proto=rpc
2015-02-12 14:51:22,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:22,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:22,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:22,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:22,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:22,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:22,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,242 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 25 submitted by user soberoi
2015-02-12 14:51:22,242 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0025
2015-02-12 14:51:22,242 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0025
2015-02-12 14:51:22,242 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0025
2015-02-12 14:51:22,242 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from NEW to NEW_SAVING
2015-02-12 14:51:22,242 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:51:22,242 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0025 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:51:22,243 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from SUBMITTED to ACCEPTED
2015-02-12 14:51:22,243 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0025
2015-02-12 14:51:22,243 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0025_000001
2015-02-12 14:51:22,243 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from NEW to SUBMITTED
2015-02-12 14:51:22,243 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0025_000001 to scheduler from user: soberoi
2015-02-12 14:51:22,244 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:51:22,245 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0025/
2015-02-12 14:51:22,245 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0025
2015-02-12 14:51:22,245 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0025/
2015-02-12 14:51:22,483 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:22,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000001
2015-02-12 14:51:22,483 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:51:22,484 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0025_01_000001
2015-02-12 14:51:22,484 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:22,484 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0025_000001
2015-02-12 14:51:22,484 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0025 AttemptId: appattempt_1423780884992_0025_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0025_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:51:22,485 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:51:22,485 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:51:22,485 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0025_000001
2015-02-12 14:51:22,486 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0025_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0025_000001
2015-02-12 14:51:22,486 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0025_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:51:22,486 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0025_000001
2015-02-12 14:51:22,486 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0025_000001
2015-02-12 14:51:22,488 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:22,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000001 by user soberoi
2015-02-12 14:51:22,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0025
2015-02-12 14:51:22,491 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000001
2015-02-12 14:51:22,491 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from NEW to INITING
2015-02-12 14:51:22,491 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000001 to application application_1423780884992_0025
2015-02-12 14:51:22,491 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0025_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0025_000001
2015-02-12 14:51:22,491 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from INITING to RUNNING
2015-02-12 14:51:22,491 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:51:22,491 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:51:22,491 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:22,492 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:22,492 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:51:22,492 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:51:22,492 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:22,492 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0025_01_000001
2015-02-12 14:51:22,502 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0025_01_000001.tokens. Credentials list:
2015-02-12 14:51:22,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:22,686 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:22,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0025_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000001.tokens
2015-02-12 14:51:22,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:22,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:22,846 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:22,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:22,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:22,902 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0025/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:22,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:22,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:22,961 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0025/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:22,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:22,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:23,030 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:23,030 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:23,067 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:23,068 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:23,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000001/default_container_executor.sh]
2015-02-12 14:51:23,303 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089 for deletion
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090 for deletion
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742091 for deletion
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742092 for deletion
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742093_1269 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742093 for deletion
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742094_1270 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742094 for deletion
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089
2015-02-12 14:51:23,305 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742091
2015-02-12 14:51:23,305 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742093_1269 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742093
2015-02-12 14:51:23,304 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090
2015-02-12 14:51:23,306 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742092
2015-02-12 14:51:23,306 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742094_1270 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742094
2015-02-12 14:51:23,484 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:23,553 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089 for deletion
2015-02-12 14:51:23,553 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090 for deletion
2015-02-12 14:51:23,554 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742092 for deletion
2015-02-12 14:51:23,554 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089
2015-02-12 14:51:23,554 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742093_1269 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742093 for deletion
2015-02-12 14:51:23,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742092
2015-02-12 14:51:23,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090
2015-02-12 14:51:23,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742094_1270 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742094 for deletion
2015-02-12 14:51:23,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742093_1269 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742093
2015-02-12 14:51:23,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742095 for deletion
2015-02-12 14:51:23,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742094_1270 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742094
2015-02-12 14:51:23,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742095
2015-02-12 14:51:23,688 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:24,689 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:25,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:25,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:51:25,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:51:25,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:51:25,117 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742100_1276 to datanode(s) 127.0.0.1:50539
2015-02-12 14:51:25,118 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742089_1265, blk_1073742090_1266, blk_1073742091_1267, blk_1073742092_1268, blk_1073742093_1269, blk_1073742095_1271]
2015-02-12 14:51:25,118 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742089_1265, blk_1073742090_1266, blk_1073742091_1267, blk_1073742094_1270, blk_1073742095_1271]
2015-02-12 14:51:25,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025 dst=null perm=null proto=rpc
2015-02-12 14:51:25,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:51:25,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:51:25,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:25,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:25,691 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:25,813 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272
2015-02-12 14:51:25,814 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271
2015-02-12 14:51:25,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742095_1271
2015-02-12 14:51:25,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272
2015-02-12 14:51:25,851 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273
2015-02-12 14:51:25,965 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089 for deletion
2015-02-12 14:51:25,965 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090 for deletion
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742091 for deletion
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742094_1270 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742094 for deletion
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742095 for deletion
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742094_1270 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742094
2015-02-12 14:51:25,966 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742091
2015-02-12 14:51:25,967 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742095
2015-02-12 14:51:25,968 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089 for deletion
2015-02-12 14:51:25,968 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090 for deletion
2015-02-12 14:51:25,968 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742091 for deletion
2015-02-12 14:51:25,968 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742092 for deletion
2015-02-12 14:51:25,968 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742093_1269 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742093 for deletion
2015-02-12 14:51:25,969 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742095 for deletion
2015-02-12 14:51:25,968 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742089
2015-02-12 14:51:25,969 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742091
2015-02-12 14:51:25,969 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742090
2015-02-12 14:51:25,970 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742092
2015-02-12 14:51:25,970 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742093_1269 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742093
2015-02-12 14:51:25,970 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742095
2015-02-12 14:51:26,304 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 to 127.0.0.1:50539
2015-02-12 14:51:26,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 src: /127.0.0.1:53391 dest: /127.0.0.1:50539
2015-02-12 14:51:26,305 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:51:26,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276 src: /127.0.0.1:53391 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:51:26,307 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742100_1276 size 254067
2015-02-12 14:51:26,468 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273
2015-02-12 14:51:26,469 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274
2015-02-12 14:51:26,499 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:26,501 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0025_000001
2015-02-12 14:51:26,501 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0025 APPATTEMPTID=appattempt_1423780884992_0025_000001
2015-02-12 14:51:26,501 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:51:26,501 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from ACCEPTED to RUNNING
2015-02-12 14:51:26,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:26,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:51:26,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:26,694 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:26,892 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274
2015-02-12 14:51:26,893 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742096_1272
2015-02-12 14:51:26,894 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275
2015-02-12 14:51:26,898 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:51:26,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280 src: /127.0.0.1:53395 dest: /127.0.0.1:50546
2015-02-12 14:51:26,950 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280 src: /127.0.0.1:53396 dest: /127.0.0.1:50539
2015-02-12 14:51:26,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280 src: /127.0.0.1:53397 dest: /127.0.0.1:50549
2015-02-12 14:51:26,992 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53397, dest: /127.0.0.1:50549, bytes: 114658, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280, duration: 39083000
2015-02-12 14:51:26,992 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:26,995 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53396, dest: /127.0.0.1:50539, bytes: 114658, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280, duration: 41820000
2015-02-12 14:51:26,995 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:26,998 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53395, dest: /127.0.0.1:50546, bytes: 114658, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280, duration: 44977000
2015-02-12 14:51:26,998 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:26,999 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:27,001 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:27,002 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:27,012 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1_conf.xml is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:27,024 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0024_01_000001 succeeded
2015-02-12 14:51:27,024 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:51:27,024 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0024_01_000001
2015-02-12 14:51:27,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:27,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000001
2015-02-12 14:51:27,051 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000001
2015-02-12 14:51:27,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000001
2015-02-12 14:51:27,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0024/container_1423780884992_0024_01_000001
2015-02-12 14:51:27,053 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000001
2015-02-12 14:51:27,054 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0024_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:51:27,054 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0024_01_000001 from application application_1423780884992_0024
2015-02-12 14:51:27,054 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:27,054 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0024
2015-02-12 14:51:27,056 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:51:27,060 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281 src: /127.0.0.1:53398 dest: /127.0.0.1:50543
2015-02-12 14:51:27,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281 src: /127.0.0.1:53399 dest: /127.0.0.1:50549
2015-02-12 14:51:27,063 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281 src: /127.0.0.1:53400 dest: /127.0.0.1:50546
2015-02-12 14:51:27,066 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53400, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281, duration: 1338000
2015-02-12 14:51:27,066 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:27,067 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:27,067 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53399, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281, duration: 2118000
2015-02-12 14:51:27,067 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:27,068 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:27,068 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53398, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281, duration: 3201000
2015-02-12 14:51:27,068 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:27,069 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:27,070 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025.summary is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:27,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0024_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:27,491 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0024_000001
2015-02-12 14:51:27,491 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0024_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:51:27,491 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0024_000001
2015-02-12 14:51:27,491 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0024_000001 State change from FINISHING to FINISHED
2015-02-12 14:51:27,491 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000001
2015-02-12 14:51:27,491 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0024 State change from FINISHING to FINISHED
2015-02-12 14:51:27,492 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0024_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:51:27,492 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0024_000001 released container container_1423780884992_0024_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:51:27,492 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0024_000001
2015-02-12 14:51:27,492 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0024_000001 is done. finalState=FINISHED
2015-02-12 14:51:27,492 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0024 requests cleared
2015-02-12 14:51:27,492 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0024
2015-02-12 14:51:27,493 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0024,name=[B2198E926A9642258DBA549CC673ABC6/00B2E0391D374C3393F68D92FC24225E] lower*upper/(1/1) ...latform/cogroupouterinner,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0024/jobhistory/job/job_1423780884992_0024,appMasterHost=10.1.1.67,startTime=1423781458114,finishTime=1423781480924,finalStatus=SUCCEEDED
2015-02-12 14:51:27,494 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0024_000001 (auth:SIMPLE)
2015-02-12 14:51:27,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0024_01_000001
2015-02-12 14:51:27,496 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0024 CONTAINERID=container_1423780884992_0024_01_000001
2015-02-12 14:51:27,496 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0024_01_000001]
2015-02-12 14:51:27,496 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:27,497 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:27,497 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,497 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,497 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,498 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0024
2015-02-12 14:51:27,498 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:27,498 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0024, with delay of 10800 seconds
2015-02-12 14:51:27,498 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,698 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:27,698 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:27,699 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:27,699 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000002
2015-02-12 14:51:27,699 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:27,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,700 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0024
2015-02-12 14:51:27,700 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:27,700 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0024, with delay of 10800 seconds
2015-02-12 14:51:27,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,903 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:27,903 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:27,903 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000003
2015-02-12 14:51:27,904 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,904 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:27,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,905 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0024
2015-02-12 14:51:27,905 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:27,905 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0024, with delay of 10800 seconds
2015-02-12 14:51:27,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,950 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:27,951 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:27,951 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000004
2015-02-12 14:51:27,951 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:27,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0024
2015-02-12 14:51:27,951 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0024
2015-02-12 14:51:27,953 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:27,953 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0024, with delay of 10800 seconds
2015-02-12 14:51:28,500 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:28,500 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000005
2015-02-12 14:51:28,500 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:51:28,566 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0025_01_000002
2015-02-12 14:51:28,567 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:28,567 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0025_01_000003
2015-02-12 14:51:28,567 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:28,568 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0025_01_000004
2015-02-12 14:51:28,568 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:28,568 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0025_01_000005
2015-02-12 14:51:28,568 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:28,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:28,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:28,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:28,701 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:28,702 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:28,702 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000006
2015-02-12 14:51:28,702 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:51:28,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:28,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:28,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:28,714 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:28,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000003 by user soberoi
2015-02-12 14:51:28,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000002 by user soberoi
2015-02-12 14:51:28,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0025
2015-02-12 14:51:28,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0025
2015-02-12 14:51:28,726 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000003
2015-02-12 14:51:28,726 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000002
2015-02-12 14:51:28,726 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from NEW to INITING
2015-02-12 14:51:28,727 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000003 to application application_1423780884992_0025
2015-02-12 14:51:28,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000005 by user soberoi
2015-02-12 14:51:28,727 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from INITING to RUNNING
2015-02-12 14:51:28,727 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000005
2015-02-12 14:51:28,727 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:51:28,727 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,727 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,727 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:28,727 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from NEW to INITING
2015-02-12 14:51:28,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000004 by user soberoi
2015-02-12 14:51:28,728 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000002 to application application_1423780884992_0025
2015-02-12 14:51:28,728 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000005 to application application_1423780884992_0025
2015-02-12 14:51:28,728 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:51:28,728 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,728 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,728 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:28,727 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0025
2015-02-12 14:51:28,729 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0025
2015-02-12 14:51:28,729 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:28,729 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:28,729 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0025_01_000003
2015-02-12 14:51:28,729 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:28,728 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from INITING to RUNNING
2015-02-12 14:51:28,729 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:51:28,729 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,730 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,730 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:28,730 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0025
2015-02-12 14:51:28,730 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:28,730 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:28,730 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0025_01_000002
2015-02-12 14:51:28,728 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0025
2015-02-12 14:51:28,730 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000004
2015-02-12 14:51:28,732 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from NEW to INITING
2015-02-12 14:51:28,732 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000004 to application application_1423780884992_0025
2015-02-12 14:51:28,732 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from INITING to RUNNING
2015-02-12 14:51:28,732 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:51:28,733 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,733 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0025
2015-02-12 14:51:28,733 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:28,733 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0025
2015-02-12 14:51:28,733 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:28,733 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:28,733 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0025_01_000004
2015-02-12 14:51:28,759 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0025_01_000003.tokens. Credentials list:
2015-02-12 14:51:28,760 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0025_01_000002.tokens. Credentials list:
2015-02-12 14:51:28,760 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0025_01_000004.tokens. Credentials list:
2015-02-12 14:51:28,815 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:28,815 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:28,905 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:28,956 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:28,969 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:28,970 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:28,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:29,051 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000005/default_container_executor.sh]
2015-02-12 14:51:29,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0025_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000003.tokens
2015-02-12 14:51:29,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:29,166 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0025_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000004.tokens
2015-02-12 14:51:29,166 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:29,167 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0025_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000002.tokens
2015-02-12 14:51:29,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:29,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:29,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:29,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:29,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:29,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:29,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:29,375 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0025/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:29,402 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0025/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:29,402 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0025/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:29,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:29,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:29,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:29,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:29,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:29,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:29,479 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0025/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:29,480 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:29,501 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:29,501 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0025/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:29,502 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:29,504 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0025/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:29,504 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:29,545 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:29,545 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:29,561 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:29,562 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:29,570 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:29,570 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:29,583 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:29,592 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:29,594 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000006 by user soberoi
2015-02-12 14:51:29,595 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000006
2015-02-12 14:51:29,595 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000006 to application application_1423780884992_0025
2015-02-12 14:51:29,595 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:51:29,595 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:29,595 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0025
2015-02-12 14:51:29,595 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:29,595 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0025
2015-02-12 14:51:29,596 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:29,661 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:29,662 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:29,702 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:29,702 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:29,703 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:29,703 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000007
2015-02-12 14:51:29,703 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:51:29,741 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000003/default_container_executor.sh]
2015-02-12 14:51:29,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000004/default_container_executor.sh]
2015-02-12 14:51:29,810 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000002/default_container_executor.sh]
2015-02-12 14:51:29,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000006/default_container_executor.sh]
2015-02-12 14:51:30,590 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:51:30,590 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:30,818 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277
2015-02-12 14:51:30,819 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275
2015-02-12 14:51:30,820 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279
2015-02-12 14:51:30,820 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742098_1274
2015-02-12 14:51:30,821 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278
2015-02-12 14:51:30,821 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742097_1273
2015-02-12 14:51:30,859 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277
2015-02-12 14:51:30,860 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742099_1275
2015-02-12 14:51:30,861 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279
2015-02-12 14:51:31,062 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276
2015-02-12 14:51:31,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277
2015-02-12 14:51:31,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278
2015-02-12 14:51:31,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742103_1279
2015-02-12 14:51:31,595 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:51:31,595 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:51:31,595 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000007
2015-02-12 14:51:31,595 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:51:31,596 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000007 on node: host: 10.1.1.67:50571 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:51:31,680 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276
2015-02-12 14:51:31,707 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0025_01_000007
2015-02-12 14:51:31,900 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742101_1277
2015-02-12 14:51:31,901 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276
2015-02-12 14:51:31,902 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742102_1278
2015-02-12 14:51:36,031 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742100_1276
2015-02-12 14:51:36,032 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280
2015-02-12 14:51:36,067 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281
2015-02-12 14:51:36,684 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281
2015-02-12 14:51:36,685 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280
2015-02-12 14:51:36,910 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742104_1280
2015-02-12 14:51:36,911 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742105_1281
2015-02-12 14:51:37,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:38,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:38,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:38,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:38,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:38,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:38,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:38,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:38,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:38,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:38,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:51:38,937 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:38,940 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000005
2015-02-12 14:51:38,940 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000005
2015-02-12 14:51:38,940 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:51:38,940 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000005
2015-02-12 14:51:38,960 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0025_01_000005 is : 143
2015-02-12 14:51:38,973 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:51:38,975 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:38,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282 src: /127.0.0.1:53438 dest: /127.0.0.1:50543
2015-02-12 14:51:38,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000005
2015-02-12 14:51:38,983 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282 src: /127.0.0.1:53439 dest: /127.0.0.1:50546
2015-02-12 14:51:38,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282 src: /127.0.0.1:53440 dest: /127.0.0.1:50549
2015-02-12 14:51:38,986 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000005
2015-02-12 14:51:38,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000005
2015-02-12 14:51:38,997 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000005
2015-02-12 14:51:38,999 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist for DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:39,000 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000005
2015-02-12 14:51:39,004 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:39,005 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000005 from application application_1423780884992_0025
2015-02-12 14:51:39,005 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:39,006 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:39,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:51:39,175 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:39,177 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000002
2015-02-12 14:51:39,177 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000002
2015-02-12 14:51:39,177 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:51:39,177 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000002
2015-02-12 14:51:39,197 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0025_01_000002 is : 143
2015-02-12 14:51:39,208 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:39,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000002
2015-02-12 14:51:39,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000002
2015-02-12 14:51:39,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000002
2015-02-12 14:51:39,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000002
2015-02-12 14:51:39,211 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000002
2015-02-12 14:51:39,212 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:39,212 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000002 from application application_1423780884992_0025
2015-02-12 14:51:39,212 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:39,213 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:39,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:51:39,264 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:39,266 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000003
2015-02-12 14:51:39,266 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000003
2015-02-12 14:51:39,266 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:51:39,266 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000003
2015-02-12 14:51:39,284 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0025_01_000003 is : 143
2015-02-12 14:51:39,302 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:39,302 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000003
2015-02-12 14:51:39,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000003
2015-02-12 14:51:39,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000003
2015-02-12 14:51:39,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000003
2015-02-12 14:51:39,304 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000003
2015-02-12 14:51:39,306 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:39,307 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000003 from application application_1423780884992_0025
2015-02-12 14:51:39,308 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:39,308 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:39,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:51:39,385 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:39,387 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000006
2015-02-12 14:51:39,388 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000006
2015-02-12 14:51:39,388 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:51:39,388 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000006
2015-02-12 14:51:39,388 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:39,388 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:51:39,388 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000002
2015-02-12 14:51:39,389 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:51:39,389 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000002 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:51:39,408 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0025_01_000006 is : 143
2015-02-12 14:51:39,419 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:39,420 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000006
2015-02-12 14:51:39,420 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000006
2015-02-12 14:51:39,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000006
2015-02-12 14:51:39,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000006
2015-02-12 14:51:39,422 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000006
2015-02-12 14:51:39,422 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:39,422 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000006 from application application_1423780884992_0025
2015-02-12 14:51:39,422 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:39,423 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:39,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:51:39,488 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:39,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000004
2015-02-12 14:51:39,490 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000004
2015-02-12 14:51:39,490 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:51:39,490 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000004
2015-02-12 14:51:39,521 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0025_01_000004 is : 143
2015-02-12 14:51:39,528 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:39,529 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000004
2015-02-12 14:51:39,529 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:39,529 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000004 from application application_1423780884992_0025
2015-02-12 14:51:39,529 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:39,529 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:39,529 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000004
2015-02-12 14:51:39,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000004
2015-02-12 14:51:39,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000004
2015-02-12 14:51:39,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000004
2015-02-12 14:51:39,588 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30002 milliseconds
2015-02-12 14:51:39,588 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:51:39,945 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:39,945 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:51:39,946 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000005
2015-02-12 14:51:39,946 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:51:39,946 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000005 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:51:40,268 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:40,268 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:51:40,268 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000003
2015-02-12 14:51:40,268 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:40,268 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:40,392 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:40,392 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:40,392 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:51:40,392 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000006
2015-02-12 14:51:40,393 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:40,393 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000006 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:40,492 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:40,492 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:51:40,493 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000004
2015-02-12 14:51:40,493 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:40,493 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:40,950 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:40,950 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:40,950 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000008
2015-02-12 14:51:40,950 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0025_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:51:41,269 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:41,395 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0025_01_000002]
2015-02-12 14:51:41,395 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:41,396 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:41,497 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:41,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:41,662 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:41,664 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0025_01_000008 by user soberoi
2015-02-12 14:51:41,664 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000008
2015-02-12 14:51:41,664 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0025_01_000008 to application application_1423780884992_0025
2015-02-12 14:51:41,664 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:51:41,664 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0025
2015-02-12 14:51:41,664 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0025
2015-02-12 14:51:41,664 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:41,665 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0025
2015-02-12 14:51:41,665 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:41,699 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:41,699 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:41,831 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000008/default_container_executor.sh]
2015-02-12 14:51:41,953 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0025_01_000005]
2015-02-12 14:51:41,953 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:41,953 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:42,271 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0025_01_000003]
2015-02-12 14:51:42,272 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:42,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0025_01_000006]
2015-02-12 14:51:42,398 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:42,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0025_01_000004]
2015-02-12 14:51:42,500 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:42,657 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:51:44,305 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:44,308 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:44,315 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:44,316 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:44,319 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:51:44,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:44,648 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:51:44,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283 src: /127.0.0.1:53454 dest: /127.0.0.1:50546
2015-02-12 14:51:44,751 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283 src: /127.0.0.1:53455 dest: /127.0.0.1:50549
2015-02-12 14:51:44,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283 src: /127.0.0.1:53456 dest: /127.0.0.1:50539
2015-02-12 14:51:44,784 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53456, dest: /127.0.0.1:50539, bytes: 172, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0025_r_000000_0_-878349225_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283, duration: 29490000
2015-02-12 14:51:44,784 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:44,785 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:51:44,785 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53455, dest: /127.0.0.1:50549, bytes: 172, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0025_r_000000_0_-878349225_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283, duration: 30220000
2015-02-12 14:51:44,786 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:44,787 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:44,788 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53454, dest: /127.0.0.1:50546, bytes: 172, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0025_r_000000_0_-878349225_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283, duration: 32876000
2015-02-12 14:51:44,788 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:44,790 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:44,799 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0025_r_000000_0_-878349225_1
2015-02-12 14:51:44,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:51:44,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:51:44,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/task_1423780884992_0025_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:51:44,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0025_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/task_1423780884992_0025_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:51:44,847 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:44,851 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000008
2015-02-12 14:51:44,852 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000008
2015-02-12 14:51:44,852 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:51:44,852 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000008
2015-02-12 14:51:44,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:44,868 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:44,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:51:44,880 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0025_01_000008 is : 143
2015-02-12 14:51:44,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:44,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:44,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/task_1423780884992_0025_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:51:44,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:44,896 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:51:44,897 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000008
2015-02-12 14:51:44,897 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000008
2015-02-12 14:51:44,898 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:51:44,898 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000008 from application application_1423780884992_0025
2015-02-12 14:51:44,898 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:44,898 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:44,898 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000008
2015-02-12 14:51:44,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary/1/task_1423780884992_0025_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:44,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000008
2015-02-12 14:51:44,900 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000008
2015-02-12 14:51:44,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:51:44,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:44,915 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:44,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:44,919 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:44,945 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53440, dest: /127.0.0.1:50549, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282, duration: 5957717000
2015-02-12 14:51:44,945 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:44,946 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16374
2015-02-12 14:51:44,947 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53439, dest: /127.0.0.1:50546, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282, duration: 5954824000
2015-02-12 14:51:44,948 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:44,949 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16374
2015-02-12 14:51:44,952 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53438, dest: /127.0.0.1:50543, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282, duration: 5964669000
2015-02-12 14:51:44,953 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742106_1282, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:44,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16374
2015-02-12 14:51:44,954 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:44,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:44,960 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:51:44,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284 src: /127.0.0.1:53458 dest: /127.0.0.1:50543
2015-02-12 14:51:44,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284 src: /127.0.0.1:53459 dest: /127.0.0.1:50539
2015-02-12 14:51:44,966 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284 src: /127.0.0.1:53460 dest: /127.0.0.1:50546
2015-02-12 14:51:44,969 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53460, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284, duration: 1283000
2015-02-12 14:51:44,969 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:44,970 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:51:44,970 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53459, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284, duration: 1832000
2015-02-12 14:51:44,970 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:44,971 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53458, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284, duration: 2697000
2015-02-12 14:51:44,971 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:51:44,971 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:44,972 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:51:44,973 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary_tmp is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:44,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:44,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:51:44,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:44,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:51:44,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:44,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:51:45,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:45,009 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:51:45,013 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285 src: /127.0.0.1:53462 dest: /127.0.0.1:50543
2015-02-12 14:51:45,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285 src: /127.0.0.1:53463 dest: /127.0.0.1:50546
2015-02-12 14:51:45,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285 src: /127.0.0.1:53464 dest: /127.0.0.1:50539
2015-02-12 14:51:45,020 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53464, dest: /127.0.0.1:50539, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285, duration: 2494000
2015-02-12 14:51:45,020 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:45,021 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:45,021 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53463, dest: /127.0.0.1:50546, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285, duration: 3022000
2015-02-12 14:51:45,021 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:45,022 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:45,022 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53462, dest: /127.0.0.1:50543, bytes: 69204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285, duration: 4171000
2015-02-12 14:51:45,022 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:45,023 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:45,025 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:45,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:45,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:51:45,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:45,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:51:45,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:51:45,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025/job_1423780884992_0025_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:51:45,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:45,044 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:51:45,047 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286 src: /127.0.0.1:53465 dest: /127.0.0.1:50539
2015-02-12 14:51:45,049 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286 src: /127.0.0.1:53466 dest: /127.0.0.1:50546
2015-02-12 14:51:45,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286 src: /127.0.0.1:53467 dest: /127.0.0.1:50549
2015-02-12 14:51:45,058 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53467, dest: /127.0.0.1:50549, bytes: 114658, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286, duration: 2869000
2015-02-12 14:51:45,058 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:45,060 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:45,061 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53466, dest: /127.0.0.1:50546, bytes: 114658, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286, duration: 5386000
2015-02-12 14:51:45,061 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:45,063 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53465, dest: /127.0.0.1:50539, bytes: 114658, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_21463981_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286, duration: 7310000
2015-02-12 14:51:45,064 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:45,065 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:45,066 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:45,070 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_21463981_1
2015-02-12 14:51:45,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:45,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:45,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:45,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:51:45,087 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0025_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:51:45,087 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:51:45,087 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0025 with final state: FINISHING
2015-02-12 14:51:45,087 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from RUNNING to FINAL_SAVING
2015-02-12 14:51:45,087 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0025
2015-02-12 14:51:45,088 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:51:45,088 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from FINAL_SAVING to FINISHING
2015-02-12 14:51:45,854 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:45,854 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:51:45,854 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000008
2015-02-12 14:51:45,854 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:51:45,855 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000008 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:51:46,091 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0025 unregistered successfully.
2015-02-12 14:51:46,095 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742100_1276 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:51:46,095 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742101_1277 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:51:46,095 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742102_1278 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:51:46,095 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742103_1279 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:51:46,096 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742105_1281 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:51:46,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742106_1282 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:51:46,097 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742104_1280 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:51:46,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0025 dst=null perm=null proto=rpc
2015-02-12 14:51:46,139 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742100_1276, blk_1073742101_1277, blk_1073742102_1278, blk_1073742103_1279, blk_1073742104_1280, blk_1073742105_1281, blk_1073742106_1282]
2015-02-12 14:51:46,139 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742100_1276, blk_1073742101_1277, blk_1073742103_1279, blk_1073742105_1281, blk_1073742106_1282]
2015-02-12 14:51:46,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,141 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary
2015-02-12 14:51:46,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:51:46,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,157 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:46,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:46,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,179 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:46,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:46,183 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner
2015-02-12 14:51:46,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:46,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:46,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:46,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner dst=null perm=null proto=rpc
2015-02-12 14:51:46,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:46,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:46,189 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup
2015-02-12 14:51:46,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:51:46,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:46,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinner-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:51:46,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,216 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:51:46,217 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:51:46,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:51:46,232 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:51:46,232 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:51:46,232 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:51:46,232 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull"]
2015-02-12 14:51:46,233 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:51:46,233 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:51:46,233 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:51:46,234 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...orm/cogroupinnerouternull
2015-02-12 14:51:46,243 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:51:46,256 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:51:46,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:51:46,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:46,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:46,262 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 26
2015-02-12 14:51:46,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026 dst=null perm=null proto=rpc
2015-02-12 14:51:46,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:51:46,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:51:46,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,273 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:51:46,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 src: /127.0.0.1:53473 dest: /127.0.0.1:50543
2015-02-12 14:51:46,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 src: /127.0.0.1:53474 dest: /127.0.0.1:50546
2015-02-12 14:51:46,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 src: /127.0.0.1:53475 dest: /127.0.0.1:50539
2015-02-12 14:51:46,284 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53475, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287, duration: 2226000
2015-02-12 14:51:46,284 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:46,285 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53474, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287, duration: 3265000
2015-02-12 14:51:46,285 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:51:46,285 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,287 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53473, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287, duration: 5289000
2015-02-12 14:51:46,287 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,287 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,289 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,290 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:46,291 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar
2015-02-12 14:51:46,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:51:46,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:51:46,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:51:46,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:51:46,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:51:46,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,302 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:46,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,304 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:46,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,307 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:46,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,310 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:51:46,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:51:46,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,319 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split
2015-02-12 14:51:46,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:46,322 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:51:46,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288 src: /127.0.0.1:53476 dest: /127.0.0.1:50546
2015-02-12 14:51:46,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288 src: /127.0.0.1:53477 dest: /127.0.0.1:50549
2015-02-12 14:51:46,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288 src: /127.0.0.1:53478 dest: /127.0.0.1:50539
2015-02-12 14:51:46,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288 src: /127.0.0.1:53479 dest: /127.0.0.1:50543
2015-02-12 14:51:46,335 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53479, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, duration: 1963000
2015-02-12 14:51:46,335 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:46,336 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:51:46,336 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53478, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, duration: 2008000
2015-02-12 14:51:46,346 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,347 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53477, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, duration: 12978000
2015-02-12 14:51:46,347 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,347 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,348 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53476, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, duration: 14223000
2015-02-12 14:51:46,348 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,349 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,350 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,351 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:46,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,356 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:51:46,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289 src: /127.0.0.1:53480 dest: /127.0.0.1:50539
2015-02-12 14:51:46,359 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289 src: /127.0.0.1:53481 dest: /127.0.0.1:50546
2015-02-12 14:51:46,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289 src: /127.0.0.1:53482 dest: /127.0.0.1:50543
2015-02-12 14:51:46,363 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53482, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289, duration: 1242000
2015-02-12 14:51:46,363 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:46,364 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,364 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53481, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289, duration: 2000000
2015-02-12 14:51:46,364 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,365 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,365 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53480, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289, duration: 2936000
2015-02-12 14:51:46,365 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,370 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,371 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:46,371 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:51:46,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:51:46,385 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:51:46,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290 src: /127.0.0.1:53483 dest: /127.0.0.1:50543
2015-02-12 14:51:46,389 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290 src: /127.0.0.1:53484 dest: /127.0.0.1:50549
2015-02-12 14:51:46,391 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290 src: /127.0.0.1:53485 dest: /127.0.0.1:50546
2015-02-12 14:51:46,396 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53485, dest: /127.0.0.1:50546, bytes: 98357, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290, duration: 3181000
2015-02-12 14:51:46,396 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:46,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,397 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53484, dest: /127.0.0.1:50549, bytes: 98357, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290, duration: 2214000
2015-02-12 14:51:46,397 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,398 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53483, dest: /127.0.0.1:50543, bytes: 98357, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290, duration: 3259000
2015-02-12 14:51:46,398 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,399 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:46,401 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:46,402 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:51:46,402 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0026
2015-02-12 14:51:46,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026 dst=null perm=null proto=rpc
2015-02-12 14:51:46,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:46,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:46,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:46,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:46,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:46,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:46,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,416 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 26 submitted by user soberoi
2015-02-12 14:51:46,417 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0026
2015-02-12 14:51:46,416 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0026
2015-02-12 14:51:46,417 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from NEW to NEW_SAVING
2015-02-12 14:51:46,417 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0026
2015-02-12 14:51:46,417 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:51:46,418 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0026 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:51:46,419 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0026
2015-02-12 14:51:46,419 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from SUBMITTED to ACCEPTED
2015-02-12 14:51:46,419 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0026_000001
2015-02-12 14:51:46,419 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from NEW to SUBMITTED
2015-02-12 14:51:46,419 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0026_000001 to scheduler from user: soberoi
2015-02-12 14:51:46,420 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:51:46,421 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0026/
2015-02-12 14:51:46,422 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0026
2015-02-12 14:51:46,422 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0026/
2015-02-12 14:51:46,516 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:46,516 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000001
2015-02-12 14:51:46,517 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:51:46,517 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0026_01_000001
2015-02-12 14:51:46,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:46,518 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0026_000001
2015-02-12 14:51:46,518 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0026 AttemptId: appattempt_1423780884992_0026_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0026_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:51:46,518 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:51:46,519 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:51:46,519 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0026_000001
2015-02-12 14:51:46,520 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0026_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0026_000001
2015-02-12 14:51:46,520 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0026_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:51:46,520 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0026_000001
2015-02-12 14:51:46,520 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0026_000001
2015-02-12 14:51:46,522 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:46,524 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000001 by user soberoi
2015-02-12 14:51:46,524 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0026
2015-02-12 14:51:46,525 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000001
2015-02-12 14:51:46,525 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from NEW to INITING
2015-02-12 14:51:46,525 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000001 to application application_1423780884992_0026
2015-02-12 14:51:46,525 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from INITING to RUNNING
2015-02-12 14:51:46,525 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0026_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0026_000001
2015-02-12 14:51:46,525 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:51:46,525 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:51:46,526 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:51:46,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:46,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:51:46,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:51:46,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:46,526 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0026_01_000001
2015-02-12 14:51:46,536 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0026_01_000001.tokens. Credentials list:
2015-02-12 14:51:46,643 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:46,746 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0026_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000001.tokens
2015-02-12 14:51:46,746 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:51:46,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:46,857 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:46,872 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0026/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:46,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:46,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:46,934 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:46,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:46,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:51:46,984 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100 for deletion
2015-02-12 14:51:46,984 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101 for deletion
2015-02-12 14:51:46,984 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742103_1279 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742103 for deletion
2015-02-12 14:51:46,984 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742105 for deletion
2015-02-12 14:51:46,984 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100
2015-02-12 14:51:46,984 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742106_1282 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742106 for deletion
2015-02-12 14:51:46,985 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101
2015-02-12 14:51:46,985 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742103_1279 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742103
2015-02-12 14:51:46,985 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742105
2015-02-12 14:51:46,985 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742106_1282 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742106
2015-02-12 14:51:47,000 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:47,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:47,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:47,065 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0026/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:47,065 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:47,098 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:47,098 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:47,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000001/default_container_executor.sh]
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100 for deletion
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101 for deletion
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742102 for deletion
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742103_1279 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742103 for deletion
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742104_1280 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742104 for deletion
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100
2015-02-12 14:51:47,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742102
2015-02-12 14:51:47,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742104_1280 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742104
2015-02-12 14:51:47,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101
2015-02-12 14:51:47,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742105 for deletion
2015-02-12 14:51:47,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742106_1282 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742106 for deletion
2015-02-12 14:51:47,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742103_1279 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742103
2015-02-12 14:51:47,321 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742105
2015-02-12 14:51:47,321 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742106_1282 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742106
2015-02-12 14:51:47,519 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:47,861 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:48,864 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:49,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:51:49,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:51:49,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:51:49,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:51:49,143 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742111_1287 to datanode(s) 127.0.0.1:50549
2015-02-12 14:51:49,143 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742100_1276, blk_1073742101_1277, blk_1073742102_1278, blk_1073742104_1280, blk_1073742105_1281, blk_1073742106_1282]
2015-02-12 14:51:49,143 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742100_1276, blk_1073742101_1277, blk_1073742102_1278, blk_1073742103_1279, blk_1073742104_1280]
2015-02-12 14:51:49,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026 dst=null perm=null proto=rpc
2015-02-12 14:51:49,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:51:49,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:51:49,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:49,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:51:49,867 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:49,986 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 to 127.0.0.1:50549
2015-02-12 14:51:49,986 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100 for deletion
2015-02-12 14:51:49,986 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101 for deletion
2015-02-12 14:51:49,986 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742102 for deletion
2015-02-12 14:51:49,987 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742103_1279 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742103 for deletion
2015-02-12 14:51:49,987 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742104_1280 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742104 for deletion
2015-02-12 14:51:49,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100
2015-02-12 14:51:49,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742102
2015-02-12 14:51:49,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101
2015-02-12 14:51:49,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742103_1279 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742103
2015-02-12 14:51:49,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742104_1280 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742104
2015-02-12 14:51:49,990 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:51:49,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 src: /127.0.0.1:53506 dest: /127.0.0.1:50549
2015-02-12 14:51:49,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287 src: /127.0.0.1:53506 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:51:49,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742111_1287 size 254067
2015-02-12 14:51:50,444 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:50,446 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0026_000001
2015-02-12 14:51:50,446 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0026 APPATTEMPTID=appattempt_1423780884992_0026_000001
2015-02-12 14:51:50,446 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:51:50,446 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from ACCEPTED to RUNNING
2015-02-12 14:51:50,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:50,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:51:50,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100 for deletion
2015-02-12 14:51:50,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101 for deletion
2015-02-12 14:51:50,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742102 for deletion
2015-02-12 14:51:50,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742104_1280 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742104 for deletion
2015-02-12 14:51:50,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742105 for deletion
2015-02-12 14:51:50,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742106_1282 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742106 for deletion
2015-02-12 14:51:50,579 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742101_1277 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742101
2015-02-12 14:51:50,579 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742100_1276 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742100
2015-02-12 14:51:50,579 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742104_1280 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742104
2015-02-12 14:51:50,579 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742102
2015-02-12 14:51:50,579 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742106_1282 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742106
2015-02-12 14:51:50,579 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742105
2015-02-12 14:51:50,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:50,838 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:51:50,838 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 2320 Total time for transactions(ms): 199 Number of transactions batched in Syncs: 9 Number of syncs: 1604 SyncTimes(ms): 534 397
2015-02-12 14:51:50,869 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:50,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291 src: /127.0.0.1:53510 dest: /127.0.0.1:50549
2015-02-12 14:51:50,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291 src: /127.0.0.1:53511 dest: /127.0.0.1:50539
2015-02-12 14:51:50,893 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291 src: /127.0.0.1:53512 dest: /127.0.0.1:50543
2015-02-12 14:51:50,930 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53512, dest: /127.0.0.1:50543, bytes: 115072, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291, duration: 32628000
2015-02-12 14:51:50,930 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:50,931 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:51:50,931 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53511, dest: /127.0.0.1:50539, bytes: 115072, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291, duration: 35391000
2015-02-12 14:51:50,934 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:50,938 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53510, dest: /127.0.0.1:50549, bytes: 115072, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291, duration: 42016000
2015-02-12 14:51:50,938 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:50,940 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:50,941 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:50,958 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:51:50,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:51:50,999 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:51:51,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292 src: /127.0.0.1:53514 dest: /127.0.0.1:50546
2015-02-12 14:51:51,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292 src: /127.0.0.1:53515 dest: /127.0.0.1:50543
2015-02-12 14:51:51,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292 src: /127.0.0.1:53516 dest: /127.0.0.1:50539
2015-02-12 14:51:51,017 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53516, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292, duration: 3642000
2015-02-12 14:51:51,018 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:51:51,018 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:51:51,019 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53515, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292, duration: 4058000
2015-02-12 14:51:51,019 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:51,020 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53514, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292, duration: 5854000
2015-02-12 14:51:51,021 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:51:51,021 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:51,022 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:51:51,026 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026.summary is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:51:51,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284
2015-02-12 14:51:51,046 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286
2015-02-12 14:51:51,047 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285
2015-02-12 14:51:51,047 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283
2015-02-12 14:51:51,081 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284
2015-02-12 14:51:51,082 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285
2015-02-12 14:51:51,231 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0025_01_000001 succeeded
2015-02-12 14:51:51,231 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:51:51,231 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0025_01_000001
2015-02-12 14:51:51,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000001
2015-02-12 14:51:51,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000001
2015-02-12 14:51:51,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000001
2015-02-12 14:51:51,247 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025/container_1423780884992_0025_01_000001
2015-02-12 14:51:51,247 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000001
2015-02-12 14:51:51,247 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0025_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:51:51,247 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0025_01_000001 from application application_1423780884992_0025
2015-02-12 14:51:51,247 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:51,247 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0025
2015-02-12 14:51:51,528 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:51,528 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000002
2015-02-12 14:51:51,528 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:51:51,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289
2015-02-12 14:51:51,701 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742109_1285
2015-02-12 14:51:51,702 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286
2015-02-12 14:51:51,871 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0025_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:51:51,871 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0025_000001
2015-02-12 14:51:51,871 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0025_000001
2015-02-12 14:51:51,871 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0025_000001 State change from FINISHING to FINISHED
2015-02-12 14:51:51,871 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0025 State change from FINISHING to FINISHED
2015-02-12 14:51:51,871 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0025_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:51:51,872 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000001
2015-02-12 14:51:51,872 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0025_000001
2015-02-12 14:51:51,872 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0025_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:51:51,872 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0025_000001 released container container_1423780884992_0025_01_000001 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:51:51,872 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:51,872 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0025
2015-02-12 14:51:51,872 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0025,name=[C50DF3680A2240F88EBE723BEF649330/CCCF3B41A5CC419BBB1C12AE7D09702B] lower*upper/(1/1) ...oupouterinner-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0025/jobhistory/job/job_1423780884992_0025,appMasterHost=10.1.1.67,startTime=1423781482242,finishTime=1423781505087,finalStatus=SUCCEEDED
2015-02-12 14:51:51,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:51,873 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000003
2015-02-12 14:51:51,873 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:51,873 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0025_000001 is done. finalState=FINISHED
2015-02-12 14:51:51,873 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0025 requests cleared
2015-02-12 14:51:51,875 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0025_000001 (auth:SIMPLE)
2015-02-12 14:51:51,876 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0025_01_000001
2015-02-12 14:51:51,876 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0025 CONTAINERID=container_1423780884992_0025_01_000001
2015-02-12 14:51:51,877 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0025_01_000001]
2015-02-12 14:51:51,877 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:51,877 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:51,877 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:51,877 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:51,878 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000004
2015-02-12 14:51:51,878 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:51:51,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:51,878 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0025
2015-02-12 14:51:51,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:51,879 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:51,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:51,878 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:51,880 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0025, with delay of 10800 seconds
2015-02-12 14:51:51,907 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287
2015-02-12 14:51:51,908 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742108_1284
2015-02-12 14:51:51,922 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283
2015-02-12 14:51:51,923 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290
2015-02-12 14:51:51,924 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742110_1286
2015-02-12 14:51:51,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288
2015-02-12 14:51:52,105 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290
2015-02-12 14:51:52,105 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742107_1283
2015-02-12 14:51:52,106 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288
2015-02-12 14:51:52,302 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:52,302 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:52,303 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000005
2015-02-12 14:51:52,303 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:52,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,304 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0025
2015-02-12 14:51:52,304 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:52,304 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0025, with delay of 10800 seconds
2015-02-12 14:51:52,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,415 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:52,416 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:51:52,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,416 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000006
2015-02-12 14:51:52,417 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:51:52,417 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0025
2015-02-12 14:51:52,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,417 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:52,417 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0025, with delay of 10800 seconds
2015-02-12 14:51:52,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,531 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:51:52,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,532 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0026_01_000002
2015-02-12 14:51:52,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0025
2015-02-12 14:51:52,532 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0025
2015-02-12 14:51:52,533 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:51:52,533 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0025, with delay of 10800 seconds
2015-02-12 14:51:52,532 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:52,534 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0026_01_000003
2015-02-12 14:51:52,534 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:52,535 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:52,535 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0026_01_000005
2015-02-12 14:51:52,535 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:52,535 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0026_01_000006
2015-02-12 14:51:52,535 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:51:52,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:52,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:52,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:51:52,678 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:52,678 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:52,678 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:52,678 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:52,681 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000002 by user soberoi
2015-02-12 14:51:52,681 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000005 by user soberoi
2015-02-12 14:51:52,682 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000002
2015-02-12 14:51:52,682 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000002 to application application_1423780884992_0026
2015-02-12 14:51:52,682 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:51:52,682 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,682 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,682 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:52,682 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0026
2015-02-12 14:51:52,682 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0026
2015-02-12 14:51:52,683 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000005
2015-02-12 14:51:52,683 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000006 by user soberoi
2015-02-12 14:51:52,684 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0026
2015-02-12 14:51:52,684 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000006
2015-02-12 14:51:52,684 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000004 by user soberoi
2015-02-12 14:51:52,685 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0026
2015-02-12 14:51:52,685 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from NEW to INITING
2015-02-12 14:51:52,685 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000006 to application application_1423780884992_0026
2015-02-12 14:51:52,685 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from INITING to RUNNING
2015-02-12 14:51:52,683 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from NEW to INITING
2015-02-12 14:51:52,686 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from NEW to INITING
2015-02-12 14:51:52,686 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000004 to application application_1423780884992_0026
2015-02-12 14:51:52,683 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:52,686 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from INITING to RUNNING
2015-02-12 14:51:52,686 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:51:52,686 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,686 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,686 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:52,686 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0026
2015-02-12 14:51:52,687 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:52,687 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:52,686 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000005 to application application_1423780884992_0026
2015-02-12 14:51:52,687 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from INITING to RUNNING
2015-02-12 14:51:52,687 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:51:52,688 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,688 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,688 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:52,688 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0026
2015-02-12 14:51:52,688 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:52,688 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:52,688 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0026_01_000005
2015-02-12 14:51:52,685 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:51:52,689 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,689 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,689 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:52,689 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0026
2015-02-12 14:51:52,689 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:51:52,690 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:51:52,690 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0026_01_000006
2015-02-12 14:51:52,685 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000004
2015-02-12 14:51:52,687 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0026_01_000004
2015-02-12 14:51:52,693 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:51:52,709 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000003 by user soberoi
2015-02-12 14:51:52,710 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000003
2015-02-12 14:51:52,710 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000003 to application application_1423780884992_0026
2015-02-12 14:51:52,710 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:51:52,710 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,711 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0026
2015-02-12 14:51:52,711 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:51:52,711 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0026
2015-02-12 14:51:52,711 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0026_01_000003
2015-02-12 14:51:52,718 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0026_01_000004.tokens. Credentials list:
2015-02-12 14:51:52,718 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0026_01_000005.tokens. Credentials list:
2015-02-12 14:51:52,719 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0026_01_000006.tokens. Credentials list:
2015-02-12 14:51:52,740 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0026_01_000003.tokens. Credentials list:
2015-02-12 14:51:52,757 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:52,757 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:52,878 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:52,878 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:52,879 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:51:52,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:52,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:52,966 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:53,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000002/default_container_executor.sh]
2015-02-12 14:51:53,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0026_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000006.tokens
2015-02-12 14:51:53,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0026_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000004.tokens
2015-02-12 14:51:53,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:51:53,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:51:53,195 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0026_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000005.tokens
2015-02-12 14:51:53,195 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:51:53,303 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:53,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:53,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:53,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:53,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:53,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:53,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar dst=null perm=null proto=rpc
2015-02-12 14:51:53,412 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:53,417 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:53,421 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0026/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:53,431 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0026/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:53,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:53,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:53,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:53,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:53,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:53,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml dst=null perm=null proto=rpc
2015-02-12 14:51:53,533 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:51:53,535 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0026/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:53,535 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:53,535 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:53,548 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:51:53,557 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0026/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:53,557 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:53,559 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:51:53,559 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:51:53,611 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:53,612 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:53,613 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:53,613 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:53,627 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:53,627 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:53,635 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:51:53,635 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:51:53,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000003/default_container_executor.sh]
2015-02-12 14:51:53,804 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000004/default_container_executor.sh]
2015-02-12 14:51:53,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000005/default_container_executor.sh]
2015-02-12 14:51:53,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000006/default_container_executor.sh]
2015-02-12 14:51:54,569 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:51:54,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0026_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000003.tokens
2015-02-12 14:51:54,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:51:56,053 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291
2015-02-12 14:51:56,053 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288
2015-02-12 14:51:56,087 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292
2015-02-12 14:51:56,089 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742114_1290
2015-02-12 14:51:56,091 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287
2015-02-12 14:51:56,255 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287
2015-02-12 14:51:56,255 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292
2015-02-12 14:51:56,256 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289
2015-02-12 14:51:56,294 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291
2015-02-12 14:51:56,294 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742113_1289
2015-02-12 14:51:56,295 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742112_1288
2015-02-12 14:51:56,932 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742115_1291
2015-02-12 14:51:56,934 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742111_1287
2015-02-12 14:51:57,114 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742116_1292
2015-02-12 14:52:01,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:02,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:02,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:02,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:02,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:02,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:02,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:02,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:02,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:02,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:02,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:02,813 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:02,815 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000002
2015-02-12 14:52:02,815 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000002
2015-02-12 14:52:02,815 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:52:02,815 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000002
2015-02-12 14:52:02,837 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0026_01_000002 is : 143
2015-02-12 14:52:02,837 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:52:02,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293 src: /127.0.0.1:53552 dest: /127.0.0.1:50549
2015-02-12 14:52:02,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293 src: /127.0.0.1:53553 dest: /127.0.0.1:50543
2015-02-12 14:52:02,844 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293 src: /127.0.0.1:53554 dest: /127.0.0.1:50539
2015-02-12 14:52:02,847 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:02,850 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000002
2015-02-12 14:52:02,851 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000002
2015-02-12 14:52:02,852 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist for DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:02,852 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000002
2015-02-12 14:52:02,853 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000002
2015-02-12 14:52:02,853 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000002
2015-02-12 14:52:02,853 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:02,853 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000002 from application application_1423780884992_0026
2015-02-12 14:52:02,854 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:02,854 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:03,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:52:03,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:52:03,168 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:03,171 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000005
2015-02-12 14:52:03,171 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000005
2015-02-12 14:52:03,171 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:52:03,171 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000005
2015-02-12 14:52:03,195 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0026_01_000005 is : 143
2015-02-12 14:52:03,207 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:03,208 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000005
2015-02-12 14:52:03,208 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000005
2015-02-12 14:52:03,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000005
2015-02-12 14:52:03,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000005
2015-02-12 14:52:03,214 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000005
2015-02-12 14:52:03,215 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:03,216 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000005 from application application_1423780884992_0026
2015-02-12 14:52:03,216 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:03,216 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:03,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:52:03,248 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:03,250 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000004
2015-02-12 14:52:03,250 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000004
2015-02-12 14:52:03,251 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:52:03,251 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000004
2015-02-12 14:52:03,274 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0026_01_000004 is : 143
2015-02-12 14:52:03,283 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:03,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000004
2015-02-12 14:52:03,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000004
2015-02-12 14:52:03,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000004
2015-02-12 14:52:03,286 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000004
2015-02-12 14:52:03,287 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000004
2015-02-12 14:52:03,287 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:03,287 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000004 from application application_1423780884992_0026
2015-02-12 14:52:03,287 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:03,287 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:03,313 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:03,316 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000003
2015-02-12 14:52:03,316 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000003
2015-02-12 14:52:03,316 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:52:03,316 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000003
2015-02-12 14:52:03,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:03,317 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:52:03,318 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000004
2015-02-12 14:52:03,318 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:52:03,318 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000004 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:52:03,346 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0026_01_000003 is : 143
2015-02-12 14:52:03,358 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:03,360 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000003
2015-02-12 14:52:03,361 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000003
2015-02-12 14:52:03,362 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000003
2015-02-12 14:52:03,362 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000003
2015-02-12 14:52:03,365 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000003
2015-02-12 14:52:03,366 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:03,366 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000003 from application application_1423780884992_0026
2015-02-12 14:52:03,366 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:03,367 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:03,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:52:03,465 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:03,467 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000006
2015-02-12 14:52:03,467 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000006
2015-02-12 14:52:03,467 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:52:03,468 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000006
2015-02-12 14:52:03,492 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0026_01_000006 is : 143
2015-02-12 14:52:03,502 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:03,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000006
2015-02-12 14:52:03,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000006
2015-02-12 14:52:03,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000006
2015-02-12 14:52:03,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000006
2015-02-12 14:52:03,504 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000006
2015-02-12 14:52:03,504 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:03,504 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000006 from application application_1423780884992_0026
2015-02-12 14:52:03,504 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:03,504 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:03,820 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:03,820 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:52:03,820 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000002
2015-02-12 14:52:03,820 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:52:03,821 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000002 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:52:04,175 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:04,176 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:52:04,176 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000005
2015-02-12 14:52:04,176 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:04,176 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:04,320 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:04,321 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:52:04,321 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000003
2015-02-12 14:52:04,321 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:04,321 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:04,321 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:04,470 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:04,470 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:52:04,470 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000006
2015-02-12 14:52:04,470 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:04,470 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000006 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:04,820 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:04,821 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:04,821 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000007
2015-02-12 14:52:04,821 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0026_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:52:05,180 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:05,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0026_01_000004]
2015-02-12 14:52:05,321 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:05,321 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:05,474 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:05,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:05,636 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:05,638 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0026_01_000007 by user soberoi
2015-02-12 14:52:05,638 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000007
2015-02-12 14:52:05,638 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0026_01_000007 to application application_1423780884992_0026
2015-02-12 14:52:05,639 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:52:05,639 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0026
2015-02-12 14:52:05,639 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0026
2015-02-12 14:52:05,639 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:05,639 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0026
2015-02-12 14:52:05,639 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:05,669 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:05,669 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:05,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000007/default_container_executor.sh]
2015-02-12 14:52:05,824 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0026_01_000002]
2015-02-12 14:52:05,824 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:05,824 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:06,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0026_01_000005]
2015-02-12 14:52:06,185 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:06,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0026_01_000003]
2015-02-12 14:52:06,323 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:06,477 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0026_01_000006]
2015-02-12 14:52:06,477 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:06,630 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:52:08,323 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:08,326 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:08,331 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:08,346 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:08,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:08,662 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:52:08,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294 src: /127.0.0.1:53567 dest: /127.0.0.1:50549
2015-02-12 14:52:08,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294 src: /127.0.0.1:53568 dest: /127.0.0.1:50543
2015-02-12 14:52:08,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294 src: /127.0.0.1:53569 dest: /127.0.0.1:50546
2015-02-12 14:52:08,811 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53569, dest: /127.0.0.1:50546, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0026_r_000000_0_-523712831_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294, duration: 44828000
2015-02-12 14:52:08,812 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:08,813 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:08,813 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53568, dest: /127.0.0.1:50543, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0026_r_000000_0_-523712831_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294, duration: 45844000
2015-02-12 14:52:08,813 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:08,815 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53567, dest: /127.0.0.1:50549, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0026_r_000000_0_-523712831_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294, duration: 47663000
2015-02-12 14:52:08,815 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:08,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:08,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:08,822 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0026_r_000000_0_-523712831_1
2015-02-12 14:52:08,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:08,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:08,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/task_1423780884992_0026_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:52:08,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/_temporary/attempt_1423780884992_0026_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/task_1423780884992_0026_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:52:08,878 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:08,882 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000007
2015-02-12 14:52:08,883 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000007
2015-02-12 14:52:08,883 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:52:08,883 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000007
2015-02-12 14:52:08,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:08,897 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:08,908 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0026_01_000007 is : 143
2015-02-12 14:52:08,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:52:08,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:08,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:08,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/task_1423780884992_0026_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:52:08,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:08,924 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:08,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000007
2015-02-12 14:52:08,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000007
2015-02-12 14:52:08,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000007
2015-02-12 14:52:08,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000007
2015-02-12 14:52:08,925 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000007
2015-02-12 14:52:08,925 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:08,926 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000007 from application application_1423780884992_0026
2015-02-12 14:52:08,926 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:08,926 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:08,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary/1/task_1423780884992_0026_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:08,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:52:08,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:08,948 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:08,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:08,953 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:08,977 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53554, dest: /127.0.0.1:50539, bytes: 69209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293, duration: 6130885000
2015-02-12 14:52:08,977 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:08,978 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 16374
2015-02-12 14:52:08,978 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53553, dest: /127.0.0.1:50543, bytes: 69209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293, duration: 6131211000
2015-02-12 14:52:08,979 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:08,980 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 16374
2015-02-12 14:52:08,980 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53552, dest: /127.0.0.1:50549, bytes: 69209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293, duration: 6134121000
2015-02-12 14:52:08,980 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742117_1293, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:08,981 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 16374
2015-02-12 14:52:08,982 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:08,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:08,987 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:52:08,989 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295 src: /127.0.0.1:53571 dest: /127.0.0.1:50549
2015-02-12 14:52:08,991 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295 src: /127.0.0.1:53572 dest: /127.0.0.1:50543
2015-02-12 14:52:08,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295 src: /127.0.0.1:53573 dest: /127.0.0.1:50539
2015-02-12 14:52:08,999 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53573, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295, duration: 2886000
2015-02-12 14:52:08,999 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:09,000 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:09,000 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53572, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295, duration: 3189000
2015-02-12 14:52:09,001 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:09,002 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53571, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295, duration: 4547000
2015-02-12 14:52:09,002 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:09,003 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:09,003 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:09,018 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary_tmp is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:09,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:09,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:09,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:09,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:09,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:09,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:09,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:09,050 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:52:09,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296 src: /127.0.0.1:53575 dest: /127.0.0.1:50549
2015-02-12 14:52:09,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296 src: /127.0.0.1:53576 dest: /127.0.0.1:50543
2015-02-12 14:52:09,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296 src: /127.0.0.1:53577 dest: /127.0.0.1:50546
2015-02-12 14:52:09,058 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53577, dest: /127.0.0.1:50546, bytes: 69209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296, duration: 1845000
2015-02-12 14:52:09,059 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:09,059 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:52:09,059 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53576, dest: /127.0.0.1:50543, bytes: 69209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296, duration: 2568000
2015-02-12 14:52:09,060 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:09,060 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:09,061 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53575, dest: /127.0.0.1:50549, bytes: 69209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296, duration: 3880000
2015-02-12 14:52:09,061 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:09,062 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:09,064 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:09,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:09,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:09,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:09,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:09,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:09,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026/job_1423780884992_0026_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:09,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:09,086 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:52:09,089 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297 src: /127.0.0.1:53578 dest: /127.0.0.1:50546
2015-02-12 14:52:09,090 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297 src: /127.0.0.1:53579 dest: /127.0.0.1:50539
2015-02-12 14:52:09,092 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297 src: /127.0.0.1:53580 dest: /127.0.0.1:50549
2015-02-12 14:52:09,098 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53580, dest: /127.0.0.1:50549, bytes: 115072, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297, duration: 3654000
2015-02-12 14:52:09,098 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:09,099 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:52:09,100 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53579, dest: /127.0.0.1:50539, bytes: 115072, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297, duration: 4464000
2015-02-12 14:52:09,100 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:09,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:52:09,101 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53578, dest: /127.0.0.1:50546, bytes: 115072, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-604627668_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297, duration: 6189000
2015-02-12 14:52:09,101 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:09,101 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:09,103 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-604627668_1
2015-02-12 14:52:09,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:09,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:09,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:09,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:09,122 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0026_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:52:09,122 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:52:09,123 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0026 with final state: FINISHING
2015-02-12 14:52:09,123 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from RUNNING to FINAL_SAVING
2015-02-12 14:52:09,123 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0026
2015-02-12 14:52:09,123 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:52:09,123 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from FINAL_SAVING to FINISHING
2015-02-12 14:52:09,592 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 14:52:09,592 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:52:09,888 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:09,888 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:52:09,888 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000007
2015-02-12 14:52:09,888 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:52:09,888 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000007 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:52:10,129 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0026 unregistered successfully.
2015-02-12 14:52:10,133 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742111_1287 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:52:10,133 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742112_1288 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:52:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742113_1289 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:52:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742114_1290 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:52:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742116_1292 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:52:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742117_1293 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:52:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742115_1291 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:52:10,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0026 dst=null perm=null proto=rpc
2015-02-12 14:52:10,169 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742112_1288, blk_1073742113_1289, blk_1073742114_1290, blk_1073742116_1292, blk_1073742111_1287]
2015-02-12 14:52:10,169 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742112_1288, blk_1073742114_1290, blk_1073742115_1291, blk_1073742117_1293, blk_1073742111_1287]
2015-02-12 14:52:10,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,172 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary
2015-02-12 14:52:10,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:52:10,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,190 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:10,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:10,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:10,211 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:10,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:10,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,228 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:52:10,229 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:52:10,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:10,242 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:52:10,242 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:52:10,242 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:52:10,242 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup"]
2015-02-12 14:52:10,242 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:52:10,242 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:52:10,243 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:52:10,244 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...nnerouternull-resultgroup
2015-02-12 14:52:10,255 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:52:10,274 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:52:10,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:10,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:10,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:10,280 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 27
2015-02-12 14:52:10,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027 dst=null perm=null proto=rpc
2015-02-12 14:52:10,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:52:10,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:52:10,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,288 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:52:10,289 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 src: /127.0.0.1:53585 dest: /127.0.0.1:50543
2015-02-12 14:52:10,291 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 src: /127.0.0.1:53586 dest: /127.0.0.1:50549
2015-02-12 14:52:10,292 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 src: /127.0.0.1:53587 dest: /127.0.0.1:50539
2015-02-12 14:52:10,296 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53587, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298, duration: 2213000
2015-02-12 14:52:10,296 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:10,297 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:52:10,297 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53586, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298, duration: 3162000
2015-02-12 14:52:10,299 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,300 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53585, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298, duration: 5677000
2015-02-12 14:52:10,300 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:52:10,301 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,301 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,304 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:10,305 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar
2015-02-12 14:52:10,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:52:10,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:52:10,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:52:10,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:52:10,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:52:10,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,323 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:10,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,326 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:10,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,329 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:10,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,331 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:10,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:10,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,337 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split
2015-02-12 14:52:10,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:10,339 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:52:10,340 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299 src: /127.0.0.1:53588 dest: /127.0.0.1:50549
2015-02-12 14:52:10,342 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299 src: /127.0.0.1:53589 dest: /127.0.0.1:50539
2015-02-12 14:52:10,343 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299 src: /127.0.0.1:53590 dest: /127.0.0.1:50543
2015-02-12 14:52:10,345 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299 src: /127.0.0.1:53591 dest: /127.0.0.1:50546
2015-02-12 14:52:10,348 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53591, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, duration: 1855000
2015-02-12 14:52:10,348 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:10,349 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:52:10,349 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53590, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, duration: 2327000
2015-02-12 14:52:10,349 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,350 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53589, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, duration: 3513000
2015-02-12 14:52:10,350 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,350 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,353 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53588, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, duration: 6265000
2015-02-12 14:52:10,353 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,354 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,356 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,357 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:10,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,364 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:52:10,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300 src: /127.0.0.1:53592 dest: /127.0.0.1:50539
2015-02-12 14:52:10,369 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300 src: /127.0.0.1:53593 dest: /127.0.0.1:50543
2015-02-12 14:52:10,371 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300 src: /127.0.0.1:53594 dest: /127.0.0.1:50546
2015-02-12 14:52:10,376 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53594, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300, duration: 2412000
2015-02-12 14:52:10,376 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:10,376 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,376 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53593, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300, duration: 1854000
2015-02-12 14:52:10,377 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,377 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,377 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53592, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300, duration: 2475000
2015-02-12 14:52:10,378 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,379 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,380 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:10,380 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:52:10,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:10,404 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:52:10,406 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301 src: /127.0.0.1:53595 dest: /127.0.0.1:50549
2015-02-12 14:52:10,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301 src: /127.0.0.1:53596 dest: /127.0.0.1:50546
2015-02-12 14:52:10,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301 src: /127.0.0.1:53597 dest: /127.0.0.1:50543
2015-02-12 14:52:10,412 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53597, dest: /127.0.0.1:50543, bytes: 98377, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301, duration: 1455000
2015-02-12 14:52:10,412 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:10,413 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,413 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53596, dest: /127.0.0.1:50546, bytes: 98377, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301, duration: 2088000
2015-02-12 14:52:10,413 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,414 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,414 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53595, dest: /127.0.0.1:50549, bytes: 98377, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301, duration: 3325000
2015-02-12 14:52:10,415 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:10,419 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:10,420 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:10,420 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0027
2015-02-12 14:52:10,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027 dst=null perm=null proto=rpc
2015-02-12 14:52:10,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:10,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:10,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:10,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:10,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:10,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:10,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,446 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 27 submitted by user soberoi
2015-02-12 14:52:10,446 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0027
2015-02-12 14:52:10,446 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0027
2015-02-12 14:52:10,446 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from NEW to NEW_SAVING
2015-02-12 14:52:10,447 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0027
2015-02-12 14:52:10,447 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:52:10,447 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0027 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:52:10,448 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from SUBMITTED to ACCEPTED
2015-02-12 14:52:10,448 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0027_000001
2015-02-12 14:52:10,448 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from NEW to SUBMITTED
2015-02-12 14:52:10,448 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0027_000001 to scheduler from user: soberoi
2015-02-12 14:52:10,449 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:52:10,449 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0027
2015-02-12 14:52:10,451 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0027/
2015-02-12 14:52:10,451 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0027
2015-02-12 14:52:10,451 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0027/
2015-02-12 14:52:10,489 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:10,489 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000001
2015-02-12 14:52:10,489 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:52:10,489 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0027_01_000001
2015-02-12 14:52:10,489 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:10,490 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0027_000001
2015-02-12 14:52:10,490 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0027 AttemptId: appattempt_1423780884992_0027_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0027_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:52:10,490 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:52:10,490 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:52:10,490 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0027_000001
2015-02-12 14:52:10,491 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0027_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0027_000001
2015-02-12 14:52:10,491 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0027_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:52:10,492 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0027_000001
2015-02-12 14:52:10,492 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0027_000001
2015-02-12 14:52:10,494 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:10,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000001 by user soberoi
2015-02-12 14:52:10,497 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0027
2015-02-12 14:52:10,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000001
2015-02-12 14:52:10,497 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from NEW to INITING
2015-02-12 14:52:10,497 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000001 to application application_1423780884992_0027
2015-02-12 14:52:10,497 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from INITING to RUNNING
2015-02-12 14:52:10,498 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:52:10,498 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:10,498 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0027_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0027_000001
2015-02-12 14:52:10,498 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:10,498 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:52:10,498 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:52:10,498 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:52:10,498 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:10,498 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0027_01_000001
2015-02-12 14:52:10,510 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0027_01_000001.tokens. Credentials list:
2015-02-12 14:52:10,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:10,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0027_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000001.tokens
2015-02-12 14:52:10,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:10,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:10,859 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0027/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:10,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:10,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:10,892 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:10,926 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0027/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:10,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:10,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:10,991 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:11,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:11,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:11,054 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0027/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:11,054 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:11,086 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:11,086 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:11,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000001/default_container_executor.sh]
2015-02-12 14:52:11,340 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112 for deletion
2015-02-12 14:52:11,340 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742113 for deletion
2015-02-12 14:52:11,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742114 for deletion
2015-02-12 14:52:11,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742116 for deletion
2015-02-12 14:52:11,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112
2015-02-12 14:52:11,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742113
2015-02-12 14:52:11,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742114
2015-02-12 14:52:11,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742116
2015-02-12 14:52:11,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111 for deletion
2015-02-12 14:52:11,343 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111
2015-02-12 14:52:11,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112 for deletion
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742114 for deletion
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742115 for deletion
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742114
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742117 for deletion
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111 for deletion
2015-02-12 14:52:11,600 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742115
2015-02-12 14:52:11,601 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742117
2015-02-12 14:52:11,601 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111
2015-02-12 14:52:11,892 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:12,896 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:13,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:13,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:52:13,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:52:13,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:52:13,171 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742122_1298 to datanode(s) 127.0.0.1:50546
2015-02-12 14:52:13,172 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742112_1288, blk_1073742113_1289, blk_1073742114_1290, blk_1073742115_1291, blk_1073742116_1292, blk_1073742117_1293, blk_1073742111_1287]
2015-02-12 14:52:13,172 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742112_1288, blk_1073742113_1289, blk_1073742115_1291, blk_1073742116_1292, blk_1073742117_1293, blk_1073742111_1287]
2015-02-12 14:52:13,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027 dst=null perm=null proto=rpc
2015-02-12 14:52:13,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:52:13,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:52:13,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:13,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:13,898 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:13,999 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112 for deletion
2015-02-12 14:52:13,999 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742113 for deletion
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742114 for deletion
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742115 for deletion
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742116 for deletion
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742117 for deletion
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742114
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742113
2015-02-12 14:52:14,001 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742115
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111 for deletion
2015-02-12 14:52:14,001 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742117
2015-02-12 14:52:14,000 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742116
2015-02-12 14:52:14,001 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111
2015-02-12 14:52:14,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112 for deletion
2015-02-12 14:52:14,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742113 for deletion
2015-02-12 14:52:14,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742115 for deletion
2015-02-12 14:52:14,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742116 for deletion
2015-02-12 14:52:14,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742112
2015-02-12 14:52:14,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742117 for deletion
2015-02-12 14:52:14,007 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111 for deletion
2015-02-12 14:52:14,007 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742113
2015-02-12 14:52:14,007 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742115
2015-02-12 14:52:14,007 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742116
2015-02-12 14:52:14,007 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742117
2015-02-12 14:52:14,008 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742111
2015-02-12 14:52:14,518 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:14,522 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0027_000001
2015-02-12 14:52:14,522 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0027 APPATTEMPTID=appattempt_1423780884992_0027_000001
2015-02-12 14:52:14,522 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:52:14,522 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from ACCEPTED to RUNNING
2015-02-12 14:52:14,603 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 to 127.0.0.1:50546
2015-02-12 14:52:14,605 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 src: /127.0.0.1:53610 dest: /127.0.0.1:50546
2015-02-12 14:52:14,606 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:52:14,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298 src: /127.0.0.1:53610 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:52:14,611 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742122_1298 size 254067
2015-02-12 14:52:14,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:14,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:52:14,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:14,903 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:15,025 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:52:15,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302 src: /127.0.0.1:53612 dest: /127.0.0.1:50546
2015-02-12 14:52:15,089 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302 src: /127.0.0.1:53613 dest: /127.0.0.1:50539
2015-02-12 14:52:15,091 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302 src: /127.0.0.1:53614 dest: /127.0.0.1:50543
2015-02-12 14:52:15,128 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53614, dest: /127.0.0.1:50543, bytes: 115092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302, duration: 35189000
2015-02-12 14:52:15,128 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:15,130 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53613, dest: /127.0.0.1:50539, bytes: 115092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302, duration: 37983000
2015-02-12 14:52:15,131 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:15,132 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53612, dest: /127.0.0.1:50546, bytes: 115092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302, duration: 39692000
2015-02-12 14:52:15,132 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:15,135 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:52:15,136 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:52:15,137 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:15,144 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:15,212 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0026_01_000001 succeeded
2015-02-12 14:52:15,212 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:52:15,212 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0026_01_000001
2015-02-12 14:52:15,243 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000001
2015-02-12 14:52:15,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000001
2015-02-12 14:52:15,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000001
2015-02-12 14:52:15,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026/container_1423780884992_0026_01_000001
2015-02-12 14:52:15,246 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000001
2015-02-12 14:52:15,248 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0026_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:52:15,249 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0026_01_000001 from application application_1423780884992_0026
2015-02-12 14:52:15,252 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:15,254 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0026
2015-02-12 14:52:15,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:15,272 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:52:15,274 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303 src: /127.0.0.1:53615 dest: /127.0.0.1:50543
2015-02-12 14:52:15,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303 src: /127.0.0.1:53616 dest: /127.0.0.1:50546
2015-02-12 14:52:15,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303 src: /127.0.0.1:53617 dest: /127.0.0.1:50539
2015-02-12 14:52:15,280 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53617, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303, duration: 1608000
2015-02-12 14:52:15,281 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:15,281 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:52:15,281 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53616, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303, duration: 2255000
2015-02-12 14:52:15,282 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:15,282 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:52:15,283 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53615, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303, duration: 3377000
2015-02-12 14:52:15,283 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:15,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:15,290 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027.summary is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:15,907 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0026_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:15,907 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0026_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:52:15,907 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0026_000001
2015-02-12 14:52:15,908 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0026_000001
2015-02-12 14:52:15,908 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0026_000001 State change from FINISHING to FINISHED
2015-02-12 14:52:15,908 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0026 State change from FINISHING to FINISHED
2015-02-12 14:52:15,909 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0026
2015-02-12 14:52:15,907 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000001
2015-02-12 14:52:15,909 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0026,name=[3419F690C01D465B8C4CB4380C42CECF/281B7A1609B542D1A0925D692D04FF6D] lower*upper/(1/1) ...orm/cogroupinnerouternull,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0026/jobhistory/job/job_1423780884992_0026,appMasterHost=10.1.1.67,startTime=1423781506416,finishTime=1423781529123,finalStatus=SUCCEEDED
2015-02-12 14:52:15,909 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0026_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:15,909 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0026_000001 released container container_1423780884992_0026_01_000001 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:15,909 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:15,909 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0026_000001
2015-02-12 14:52:15,910 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:15,910 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000002
2015-02-12 14:52:15,910 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:15,910 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0026_000001 is done. finalState=FINISHED
2015-02-12 14:52:15,910 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0026 requests cleared
2015-02-12 14:52:15,913 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0026_000001 (auth:SIMPLE)
2015-02-12 14:52:15,915 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0026_01_000001
2015-02-12 14:52:15,915 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0026 CONTAINERID=container_1423780884992_0026_01_000001
2015-02-12 14:52:15,915 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0026_01_000001]
2015-02-12 14:52:15,915 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:15,916 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:15,916 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:15,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:15,916 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:15,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:15,917 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0026
2015-02-12 14:52:15,917 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:15,917 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:15,916 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000003
2015-02-12 14:52:15,918 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:52:15,917 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:15,918 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0026, with delay of 10800 seconds
2015-02-12 14:52:16,220 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:16,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:16,221 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000004
2015-02-12 14:52:16,221 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:16,222 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0026
2015-02-12 14:52:16,222 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,222 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,222 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:16,223 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0026, with delay of 10800 seconds
2015-02-12 14:52:16,223 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,224 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300
2015-02-12 14:52:16,281 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297
2015-02-12 14:52:16,316 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300
2015-02-12 14:52:16,318 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298
2015-02-12 14:52:16,318 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294
2015-02-12 14:52:16,353 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:16,353 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:16,353 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000005
2015-02-12 14:52:16,354 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:16,354 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,354 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,355 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0026
2015-02-12 14:52:16,355 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:16,355 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0026, with delay of 10800 seconds
2015-02-12 14:52:16,354 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,485 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298
2015-02-12 14:52:16,485 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299
2015-02-12 14:52:16,487 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295
2015-02-12 14:52:16,505 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:16,506 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:16,506 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000006
2015-02-12 14:52:16,506 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:52:16,506 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,507 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0026
2015-02-12 14:52:16,507 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,507 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:16,507 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0026, with delay of 10800 seconds
2015-02-12 14:52:16,507 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,507 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0026
2015-02-12 14:52:16,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301
2015-02-12 14:52:16,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295
2015-02-12 14:52:16,523 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296
2015-02-12 14:52:16,523 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299
2015-02-12 14:52:16,651 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0027_01_000002
2015-02-12 14:52:16,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:16,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:16,652 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0027_01_000004
2015-02-12 14:52:16,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:16,653 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0027_01_000005
2015-02-12 14:52:16,653 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:16,653 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0027_01_000006
2015-02-12 14:52:16,653 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:16,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:16,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:16,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:16,832 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:16,833 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:16,834 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:16,834 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:16,834 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:16,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000004 by user soberoi
2015-02-12 14:52:16,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0027
2015-02-12 14:52:16,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000005 by user soberoi
2015-02-12 14:52:16,840 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000004
2015-02-12 14:52:16,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000002 by user soberoi
2015-02-12 14:52:16,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0027
2015-02-12 14:52:16,841 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000002
2015-02-12 14:52:16,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0027
2015-02-12 14:52:16,841 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000005
2015-02-12 14:52:16,841 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from NEW to INITING
2015-02-12 14:52:16,842 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000005 to application application_1423780884992_0027
2015-02-12 14:52:16,842 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from INITING to RUNNING
2015-02-12 14:52:16,842 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:52:16,842 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,843 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,843 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:16,843 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0027
2015-02-12 14:52:16,843 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:16,843 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:16,843 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0027_01_000005
2015-02-12 14:52:16,841 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from NEW to INITING
2015-02-12 14:52:16,846 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000002 to application application_1423780884992_0027
2015-02-12 14:52:16,846 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from INITING to RUNNING
2015-02-12 14:52:16,848 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:52:16,848 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,841 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from NEW to INITING
2015-02-12 14:52:16,848 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000004 to application application_1423780884992_0027
2015-02-12 14:52:16,848 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from INITING to RUNNING
2015-02-12 14:52:16,849 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:52:16,849 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,849 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,849 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:16,851 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0027
2015-02-12 14:52:16,851 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:16,851 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:16,852 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0027_01_000004
2015-02-12 14:52:16,848 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,853 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:16,853 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0027
2015-02-12 14:52:16,853 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:16,853 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:16,853 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0027_01_000002
2015-02-12 14:52:16,846 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000006 by user soberoi
2015-02-12 14:52:16,856 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000006
2015-02-12 14:52:16,856 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000003 by user soberoi
2015-02-12 14:52:16,857 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000003
2015-02-12 14:52:16,858 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000006 to application application_1423780884992_0027
2015-02-12 14:52:16,860 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:52:16,861 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,861 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,861 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:16,861 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0027
2015-02-12 14:52:16,862 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:16,872 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000003 to application application_1423780884992_0027
2015-02-12 14:52:16,872 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:52:16,872 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,872 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0027
2015-02-12 14:52:16,872 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:16,872 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0027
2015-02-12 14:52:16,873 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0027_01_000003
2015-02-12 14:52:16,903 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0027_01_000005.tokens. Credentials list:
2015-02-12 14:52:16,915 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0027_01_000004.tokens. Credentials list:
2015-02-12 14:52:16,920 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:16,920 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:16,920 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:16,920 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0027_01_000002.tokens. Credentials list:
2015-02-12 14:52:16,922 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0027_01_000003.tokens. Credentials list:
2015-02-12 14:52:16,948 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742119_1295
2015-02-12 14:52:16,949 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294
2015-02-12 14:52:16,950 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297
2015-02-12 14:52:16,951 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299
2015-02-12 14:52:16,952 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296
2015-02-12 14:52:16,972 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:16,973 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:17,131 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742124_1300
2015-02-12 14:52:17,132 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301
2015-02-12 14:52:17,133 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742121_1297
2015-02-12 14:52:17,133 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742118_1294
2015-02-12 14:52:17,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742120_1296
2015-02-12 14:52:17,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742123_1299
2015-02-12 14:52:17,151 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742125_1301
2015-02-12 14:52:17,190 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:17,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:17,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:17,227 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:17,283 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000006/default_container_executor.sh]
2015-02-12 14:52:17,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298
2015-02-12 14:52:17,357 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:17,410 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0027_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000004.tokens
2015-02-12 14:52:17,410 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:17,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0027_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000002.tokens
2015-02-12 14:52:17,413 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:17,440 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0027_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000005.tokens
2015-02-12 14:52:17,440 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:17,506 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:17,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:17,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:17,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:17,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:17,669 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:52:17,716 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0027/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:17,725 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0027/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:17,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:17,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:17,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:17,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:17,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:17,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:17,809 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0027/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:17,838 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0027/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:17,838 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:17,838 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:17,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:17,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:17,948 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0027/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:17,948 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:17,963 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:17,963 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:18,016 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:18,016 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:18,045 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:18,045 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:18,065 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0027/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:18,065 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:18,131 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:18,131 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:18,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000003/default_container_executor.sh]
2015-02-12 14:52:18,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000002/default_container_executor.sh]
2015-02-12 14:52:18,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000004/default_container_executor.sh]
2015-02-12 14:52:18,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000005/default_container_executor.sh]
2015-02-12 14:52:18,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:19,039 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0027_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000003.tokens
2015-02-12 14:52:19,039 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:21,491 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303
2015-02-12 14:52:21,492 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302
2015-02-12 14:52:21,530 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302
2015-02-12 14:52:21,530 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303
2015-02-12 14:52:22,142 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742126_1302
2015-02-12 14:52:22,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742127_1303
2015-02-12 14:52:22,343 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742122_1298
2015-02-12 14:52:27,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:27,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:27,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:27,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:27,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:27,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:27,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:27,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:27,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:27,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:28,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:52:28,074 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:28,076 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000006
2015-02-12 14:52:28,076 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000006
2015-02-12 14:52:28,076 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:52:28,076 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000006
2015-02-12 14:52:28,103 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:52:28,103 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0027_01_000006 is : 143
2015-02-12 14:52:28,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304 src: /127.0.0.1:53667 dest: /127.0.0.1:50539
2015-02-12 14:52:28,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304 src: /127.0.0.1:53668 dest: /127.0.0.1:50546
2015-02-12 14:52:28,120 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304 src: /127.0.0.1:53669 dest: /127.0.0.1:50543
2015-02-12 14:52:28,130 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:28,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000006
2015-02-12 14:52:28,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000006
2015-02-12 14:52:28,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000006
2015-02-12 14:52:28,133 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist for DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:28,137 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000006
2015-02-12 14:52:28,138 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000006
2015-02-12 14:52:28,139 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:28,139 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000006 from application application_1423780884992_0027
2015-02-12 14:52:28,139 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:28,139 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:28,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:52:28,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:52:28,395 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:28,397 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000003
2015-02-12 14:52:28,397 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000003
2015-02-12 14:52:28,397 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:52:28,397 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000003
2015-02-12 14:52:28,416 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0027_01_000003 is : 143
2015-02-12 14:52:28,427 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:28,428 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:28,430 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000005
2015-02-12 14:52:28,430 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000005
2015-02-12 14:52:28,430 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:52:28,430 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000005
2015-02-12 14:52:28,432 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000003
2015-02-12 14:52:28,433 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000003
2015-02-12 14:52:28,434 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000003
2015-02-12 14:52:28,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000003
2015-02-12 14:52:28,441 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000003
2015-02-12 14:52:28,441 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:28,441 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000003 from application application_1423780884992_0027
2015-02-12 14:52:28,442 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:28,442 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:28,455 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0027_01_000005 is : 143
2015-02-12 14:52:28,464 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:28,465 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000005
2015-02-12 14:52:28,465 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000005
2015-02-12 14:52:28,465 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000005
2015-02-12 14:52:28,466 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:28,466 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000005 from application application_1423780884992_0027
2015-02-12 14:52:28,466 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:28,466 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:28,466 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000005
2015-02-12 14:52:28,466 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000005
2015-02-12 14:52:28,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:28,523 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:28,525 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000002
2015-02-12 14:52:28,525 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000002
2015-02-12 14:52:28,525 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:52:28,529 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000002
2015-02-12 14:52:28,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:28,530 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:52:28,530 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000003
2015-02-12 14:52:28,530 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:52:28,530 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000003 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:52:28,554 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0027_01_000002 is : 143
2015-02-12 14:52:28,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:52:28,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:28,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000002
2015-02-12 14:52:28,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000002
2015-02-12 14:52:28,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000002
2015-02-12 14:52:28,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000002
2015-02-12 14:52:28,569 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000002
2015-02-12 14:52:28,569 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:28,569 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000002 from application application_1423780884992_0027
2015-02-12 14:52:28,569 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:28,569 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:28,605 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:28,607 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000004
2015-02-12 14:52:28,607 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000004
2015-02-12 14:52:28,607 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:52:28,608 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000004
2015-02-12 14:52:28,625 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0027_01_000004 is : 143
2015-02-12 14:52:28,634 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:28,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000004
2015-02-12 14:52:28,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000004
2015-02-12 14:52:28,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000004
2015-02-12 14:52:28,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000004
2015-02-12 14:52:28,636 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000004
2015-02-12 14:52:28,636 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:28,636 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000004 from application application_1423780884992_0027
2015-02-12 14:52:28,636 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:28,636 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:29,082 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:29,082 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:52:29,082 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000006
2015-02-12 14:52:29,082 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:52:29,082 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:52:29,432 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:29,432 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:52:29,432 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000005
2015-02-12 14:52:29,432 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:29,432 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000005 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:29,533 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:29,533 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:52:29,533 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000002
2015-02-12 14:52:29,533 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:29,533 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000002 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:29,534 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:29,613 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:29,614 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:52:29,614 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000004
2015-02-12 14:52:29,614 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:29,614 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:30,084 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:30,084 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:30,085 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000007
2015-02-12 14:52:30,085 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0027_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:52:30,436 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:30,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0027_01_000003]
2015-02-12 14:52:30,538 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:30,538 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:30,618 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:30,726 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:30,736 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:30,738 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0027_01_000007 by user soberoi
2015-02-12 14:52:30,738 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000007
2015-02-12 14:52:30,738 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0027_01_000007 to application application_1423780884992_0027
2015-02-12 14:52:30,738 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:52:30,738 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0027
2015-02-12 14:52:30,738 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0027
2015-02-12 14:52:30,739 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:30,739 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0027
2015-02-12 14:52:30,739 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:30,776 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:30,776 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:30,880 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000007/default_container_executor.sh]
2015-02-12 14:52:31,088 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0027_01_000006]
2015-02-12 14:52:31,088 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:31,088 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:31,436 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0027_01_000005]
2015-02-12 14:52:31,436 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:31,540 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0027_01_000002]
2015-02-12 14:52:31,540 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:31,621 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0027_01_000004]
2015-02-12 14:52:31,621 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:31,733 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:52:33,309 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:33,314 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:33,319 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:33,321 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:33,329 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:33,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:33,676 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:52:33,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305 src: /127.0.0.1:53684 dest: /127.0.0.1:50549
2015-02-12 14:52:33,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305 src: /127.0.0.1:53685 dest: /127.0.0.1:50543
2015-02-12 14:52:33,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305 src: /127.0.0.1:53686 dest: /127.0.0.1:50546
2015-02-12 14:52:33,807 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53686, dest: /127.0.0.1:50546, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0027_r_000000_0_1246349521_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305, duration: 36854000
2015-02-12 14:52:33,807 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:33,808 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:33,808 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53685, dest: /127.0.0.1:50543, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0027_r_000000_0_1246349521_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305, duration: 37833000
2015-02-12 14:52:33,808 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:33,809 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53684, dest: /127.0.0.1:50549, bytes: 219, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0027_r_000000_0_1246349521_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305, duration: 38726000
2015-02-12 14:52:33,809 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:33,810 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:33,810 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:33,822 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0027_r_000000_0_1246349521_1
2015-02-12 14:52:33,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:33,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:33,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/task_1423780884992_0027_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:52:33,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0027_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/task_1423780884992_0027_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:52:33,874 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:33,877 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000007
2015-02-12 14:52:33,877 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000007
2015-02-12 14:52:33,880 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:52:33,881 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000007
2015-02-12 14:52:33,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:33,903 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:33,911 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0027_01_000007 is : 143
2015-02-12 14:52:33,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:52:33,922 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:33,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000007
2015-02-12 14:52:33,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000007
2015-02-12 14:52:33,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000007
2015-02-12 14:52:33,923 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000007
2015-02-12 14:52:33,923 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:33,923 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000007 from application application_1423780884992_0027
2015-02-12 14:52:33,923 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:33,924 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000007
2015-02-12 14:52:33,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:33,924 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:33,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:33,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/task_1423780884992_0027_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:52:33,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:33,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary/1/task_1423780884992_0027_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:33,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:52:33,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:33,950 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:33,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:33,956 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:33,985 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53669, dest: /127.0.0.1:50543, bytes: 69211, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304, duration: 5861929000
2015-02-12 14:52:33,986 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:33,987 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16374
2015-02-12 14:52:33,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53668, dest: /127.0.0.1:50546, bytes: 69211, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304, duration: 5863584000
2015-02-12 14:52:33,988 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:33,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16374
2015-02-12 14:52:33,990 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53667, dest: /127.0.0.1:50539, bytes: 69211, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304, duration: 5865482000
2015-02-12 14:52:33,990 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742128_1304, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:33,992 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:33,993 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742128_1304 size 69211
2015-02-12 14:52:34,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:34,006 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:52:34,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306 src: /127.0.0.1:53688 dest: /127.0.0.1:50549
2015-02-12 14:52:34,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306 src: /127.0.0.1:53689 dest: /127.0.0.1:50546
2015-02-12 14:52:34,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306 src: /127.0.0.1:53690 dest: /127.0.0.1:50543
2015-02-12 14:52:34,028 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53690, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306, duration: 2935000
2015-02-12 14:52:34,029 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:34,030 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53689, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306, duration: 3842000
2015-02-12 14:52:34,030 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,030 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:34,031 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53688, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306, duration: 5740000
2015-02-12 14:52:34,032 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:34,033 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,033 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,036 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:34,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:34,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:34,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:34,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:34,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:34,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:34,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:34,071 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:52:34,074 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307 src: /127.0.0.1:53692 dest: /127.0.0.1:50549
2015-02-12 14:52:34,076 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307 src: /127.0.0.1:53693 dest: /127.0.0.1:50539
2015-02-12 14:52:34,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307 src: /127.0.0.1:53694 dest: /127.0.0.1:50546
2015-02-12 14:52:34,085 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53694, dest: /127.0.0.1:50546, bytes: 69211, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307, duration: 2407000
2015-02-12 14:52:34,085 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:34,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:34,086 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53693, dest: /127.0.0.1:50539, bytes: 69211, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307, duration: 3467000
2015-02-12 14:52:34,087 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:34,089 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53692, dest: /127.0.0.1:50549, bytes: 69211, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307, duration: 6097000
2015-02-12 14:52:34,090 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:34,089 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,092 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,095 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:34,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:34,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:34,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:34,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:34,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:34,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027/job_1423780884992_0027_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:34,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:34,113 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:52:34,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308 src: /127.0.0.1:53696 dest: /127.0.0.1:50539
2015-02-12 14:52:34,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308 src: /127.0.0.1:53697 dest: /127.0.0.1:50549
2015-02-12 14:52:34,119 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308 src: /127.0.0.1:53698 dest: /127.0.0.1:50543
2015-02-12 14:52:34,122 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53698, dest: /127.0.0.1:50543, bytes: 115092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308, duration: 1931000
2015-02-12 14:52:34,122 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:34,123 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,123 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53697, dest: /127.0.0.1:50549, bytes: 115092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308, duration: 2627000
2015-02-12 14:52:34,123 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:34,124 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,124 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53696, dest: /127.0.0.1:50539, bytes: 115092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1956682413_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308, duration: 3515000
2015-02-12 14:52:34,124 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:34,125 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:34,126 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1956682413_1
2015-02-12 14:52:34,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:34,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:34,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:34,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:34,150 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0027_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:52:34,151 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:52:34,152 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0027 with final state: FINISHING
2015-02-12 14:52:34,152 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from RUNNING to FINAL_SAVING
2015-02-12 14:52:34,153 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:52:34,153 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0027
2015-02-12 14:52:34,153 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from FINAL_SAVING to FINISHING
2015-02-12 14:52:34,885 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:34,885 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:52:34,885 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000007
2015-02-12 14:52:34,886 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:52:34,886 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000007 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:52:35,161 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0027 unregistered successfully.
2015-02-12 14:52:35,166 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742122_1298 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:52:35,166 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742123_1299 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:52:35,166 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742124_1300 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:52:35,167 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742125_1301 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:52:35,167 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742127_1303 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:52:35,167 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742128_1304 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:52:35,167 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742126_1302 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:52:35,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0027 dst=null perm=null proto=rpc
2015-02-12 14:52:35,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,203 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary
2015-02-12 14:52:35,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:52:35,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,223 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:35,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:35,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,246 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:35,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:35,249 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull
2015-02-12 14:52:35,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:35,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:35,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:35,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull dst=null perm=null proto=rpc
2015-02-12 14:52:35,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:35,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:35,257 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup
2015-02-12 14:52:35,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:35,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:35,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnerouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:35,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,282 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:52:35,282 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:52:35,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull"]
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:52:35,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:52:35,307 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...platform/cogroupouternull
2015-02-12 14:52:35,316 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:52:35,332 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:52:35,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:35,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:35,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:35,343 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 28
2015-02-12 14:52:35,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028 dst=null perm=null proto=rpc
2015-02-12 14:52:35,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:52:35,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:52:35,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,354 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:52:35,357 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 src: /127.0.0.1:53704 dest: /127.0.0.1:50543
2015-02-12 14:52:35,359 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 src: /127.0.0.1:53705 dest: /127.0.0.1:50549
2015-02-12 14:52:35,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 src: /127.0.0.1:53706 dest: /127.0.0.1:50539
2015-02-12 14:52:35,365 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53706, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309, duration: 3455000
2015-02-12 14:52:35,365 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:35,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,366 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53705, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309, duration: 3791000
2015-02-12 14:52:35,366 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,367 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53704, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309, duration: 4800000
2015-02-12 14:52:35,367 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,368 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,370 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,371 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:35,371 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar
2015-02-12 14:52:35,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:52:35,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:52:35,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:52:35,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:52:35,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:52:35,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,382 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:35,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,385 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:35,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,390 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:35,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,392 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:35,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:35,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,401 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split
2015-02-12 14:52:35,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:35,403 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:52:35,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310 src: /127.0.0.1:53707 dest: /127.0.0.1:50539
2015-02-12 14:52:35,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310 src: /127.0.0.1:53708 dest: /127.0.0.1:50543
2015-02-12 14:52:35,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310 src: /127.0.0.1:53709 dest: /127.0.0.1:50549
2015-02-12 14:52:35,413 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310 src: /127.0.0.1:53710 dest: /127.0.0.1:50546
2015-02-12 14:52:35,417 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53710, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, duration: 2128000
2015-02-12 14:52:35,418 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:35,419 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53709, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, duration: 3014000
2015-02-12 14:52:35,419 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,421 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53708, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, duration: 5727000
2015-02-12 14:52:35,421 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,422 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,424 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53707, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, duration: 8624000
2015-02-12 14:52:35,424 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,428 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,430 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,431 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,435 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:35,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,440 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:52:35,441 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311 src: /127.0.0.1:53711 dest: /127.0.0.1:50543
2015-02-12 14:52:35,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311 src: /127.0.0.1:53712 dest: /127.0.0.1:50539
2015-02-12 14:52:35,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311 src: /127.0.0.1:53713 dest: /127.0.0.1:50546
2015-02-12 14:52:35,448 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53713, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311, duration: 1589000
2015-02-12 14:52:35,449 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:35,450 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:35,450 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53712, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311, duration: 3734000
2015-02-12 14:52:35,450 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,451 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:35,451 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53711, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311, duration: 4833000
2015-02-12 14:52:35,451 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,454 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:35,455 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:35,456 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:52:35,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:35,471 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:52:35,474 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312 src: /127.0.0.1:53714 dest: /127.0.0.1:50549
2015-02-12 14:52:35,475 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312 src: /127.0.0.1:53715 dest: /127.0.0.1:50546
2015-02-12 14:52:35,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312 src: /127.0.0.1:53716 dest: /127.0.0.1:50543
2015-02-12 14:52:35,481 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53716, dest: /127.0.0.1:50543, bytes: 98352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312, duration: 3199000
2015-02-12 14:52:35,481 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:35,482 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,482 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53715, dest: /127.0.0.1:50546, bytes: 98352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312, duration: 3684000
2015-02-12 14:52:35,482 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,482 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,483 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53714, dest: /127.0.0.1:50549, bytes: 98352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312, duration: 4803000
2015-02-12 14:52:35,483 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:35,487 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:35,488 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:35,489 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0028
2015-02-12 14:52:35,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028 dst=null perm=null proto=rpc
2015-02-12 14:52:35,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:35,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:35,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:35,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:35,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:35,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:35,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,510 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 28 submitted by user soberoi
2015-02-12 14:52:35,510 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0028
2015-02-12 14:52:35,510 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0028
2015-02-12 14:52:35,511 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0028
2015-02-12 14:52:35,510 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from NEW to NEW_SAVING
2015-02-12 14:52:35,511 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:52:35,511 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0028 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:52:35,512 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from SUBMITTED to ACCEPTED
2015-02-12 14:52:35,512 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0028_000001
2015-02-12 14:52:35,512 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from NEW to SUBMITTED
2015-02-12 14:52:35,512 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0028
2015-02-12 14:52:35,512 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0028_000001 to scheduler from user: soberoi
2015-02-12 14:52:35,513 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:52:35,515 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0028/
2015-02-12 14:52:35,515 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0028
2015-02-12 14:52:35,515 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0028/
2015-02-12 14:52:35,559 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:35,560 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000001
2015-02-12 14:52:35,560 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:52:35,560 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0028_01_000001
2015-02-12 14:52:35,561 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:35,561 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0028_000001
2015-02-12 14:52:35,561 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0028 AttemptId: appattempt_1423780884992_0028_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0028_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:52:35,561 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:52:35,562 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:52:35,562 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0028_000001
2015-02-12 14:52:35,563 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0028_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0028_000001
2015-02-12 14:52:35,563 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0028_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:52:35,563 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0028_000001
2015-02-12 14:52:35,563 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0028_000001
2015-02-12 14:52:35,566 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:35,570 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000001 by user soberoi
2015-02-12 14:52:35,570 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0028
2015-02-12 14:52:35,571 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000001
2015-02-12 14:52:35,571 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from NEW to INITING
2015-02-12 14:52:35,571 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000001 to application application_1423780884992_0028
2015-02-12 14:52:35,571 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from INITING to RUNNING
2015-02-12 14:52:35,571 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0028_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0028_000001
2015-02-12 14:52:35,571 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:52:35,571 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:52:35,572 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:35,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:35,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:52:35,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:52:35,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:35,572 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0028_01_000001
2015-02-12 14:52:35,581 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0028_01_000001.tokens. Credentials list:
2015-02-12 14:52:35,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:35,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0028_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000001.tokens
2015-02-12 14:52:35,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:52:35,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:35,888 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:35,916 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:35,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:35,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:35,990 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0028/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:36,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:36,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:36,061 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0028/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:36,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:36,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:36,120 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0028/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:36,120 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:36,160 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:36,160 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:36,269 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000001/default_container_executor.sh]
2015-02-12 14:52:36,558 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:36,893 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:37,196 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742133_1309 to datanode(s) 127.0.0.1:50546
2015-02-12 14:52:37,197 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742128_1304, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742125_1301, blk_1073742126_1302, blk_1073742127_1303]
2015-02-12 14:52:37,197 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742128_1304, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742126_1302, blk_1073742127_1303]
2015-02-12 14:52:37,898 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:38,028 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 to 127.0.0.1:50546
2015-02-12 14:52:38,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742128_1304 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742128 for deletion
2015-02-12 14:52:38,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122 for deletion
2015-02-12 14:52:38,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123 for deletion
2015-02-12 14:52:38,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742124 for deletion
2015-02-12 14:52:38,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742126 for deletion
2015-02-12 14:52:38,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742127_1303 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742127 for deletion
2015-02-12 14:52:38,030 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122
2015-02-12 14:52:38,030 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742128_1304 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742128
2015-02-12 14:52:38,030 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:52:38,030 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742124
2015-02-12 14:52:38,030 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123
2015-02-12 14:52:38,030 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742127_1303 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742127
2015-02-12 14:52:38,031 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 src: /127.0.0.1:53721 dest: /127.0.0.1:50546
2015-02-12 14:52:38,031 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742126
2015-02-12 14:52:38,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309 src: /127.0.0.1:53721 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:52:38,033 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742133_1309 size 254067
2015-02-12 14:52:38,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:38,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:52:38,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:52:38,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:52:38,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028 dst=null perm=null proto=rpc
2015-02-12 14:52:38,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:52:38,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742128_1304 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742128 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742124 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742128_1304 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742128
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742125 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742126 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742127_1303 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742127 for deletion
2015-02-12 14:52:38,358 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123
2015-02-12 14:52:38,359 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122
2015-02-12 14:52:38,359 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742125
2015-02-12 14:52:38,359 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742124
2015-02-12 14:52:38,359 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742126
2015-02-12 14:52:38,359 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742127_1303 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742127
2015-02-12 14:52:38,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:38,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:38,899 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:39,465 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:39,467 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0028_000001
2015-02-12 14:52:39,467 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0028 APPATTEMPTID=appattempt_1423780884992_0028_000001
2015-02-12 14:52:39,467 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:52:39,467 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from ACCEPTED to RUNNING
2015-02-12 14:52:39,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:39,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:52:39,597 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 14:52:39,597 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:52:39,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:39,902 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:39,928 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:52:39,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313 src: /127.0.0.1:53729 dest: /127.0.0.1:50546
2015-02-12 14:52:39,987 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313 src: /127.0.0.1:53730 dest: /127.0.0.1:50543
2015-02-12 14:52:39,991 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313 src: /127.0.0.1:53731 dest: /127.0.0.1:50549
2015-02-12 14:52:40,024 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53731, dest: /127.0.0.1:50549, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313, duration: 30320000
2015-02-12 14:52:40,024 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:40,026 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53730, dest: /127.0.0.1:50543, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313, duration: 33144000
2015-02-12 14:52:40,027 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:40,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:40,028 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53729, dest: /127.0.0.1:50546, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313, duration: 34864000
2015-02-12 14:52:40,029 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:40,030 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:40,031 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:40,046 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1_conf.xml is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:40,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:40,083 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:52:40,085 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314 src: /127.0.0.1:53732 dest: /127.0.0.1:50549
2015-02-12 14:52:40,087 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314 src: /127.0.0.1:53733 dest: /127.0.0.1:50539
2015-02-12 14:52:40,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314 src: /127.0.0.1:53734 dest: /127.0.0.1:50546
2015-02-12 14:52:40,092 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53734, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314, duration: 1744000
2015-02-12 14:52:40,092 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:40,093 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53733, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314, duration: 2661000
2015-02-12 14:52:40,094 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:40,095 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53732, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314, duration: 4403000
2015-02-12 14:52:40,095 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:40,095 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:40,096 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:40,097 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:52:40,100 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028.summary is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:40,200 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742122_1298, blk_1073742123_1299, blk_1073742125_1301]
2015-02-12 14:52:40,200 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742128_1304, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742125_1301, blk_1073742126_1302, blk_1073742127_1303]
2015-02-12 14:52:40,207 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0027_01_000001 succeeded
2015-02-12 14:52:40,207 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:52:40,207 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0027_01_000001
2015-02-12 14:52:40,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000001
2015-02-12 14:52:40,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000001
2015-02-12 14:52:40,221 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000001
2015-02-12 14:52:40,221 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0027_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:52:40,221 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0027_01_000001 from application application_1423780884992_0027
2015-02-12 14:52:40,221 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:40,221 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0027
2015-02-12 14:52:40,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000001
2015-02-12 14:52:40,222 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0027/container_1423780884992_0027_01_000001
2015-02-12 14:52:40,570 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:40,570 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000002
2015-02-12 14:52:40,570 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:52:40,645 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:40,645 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000003
2015-02-12 14:52:40,646 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:40,905 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0027_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:40,906 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0027_000001
2015-02-12 14:52:40,906 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0027_000001
2015-02-12 14:52:40,906 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0027_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:52:40,906 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0027_000001 State change from FINISHING to FINISHED
2015-02-12 14:52:40,907 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000001
2015-02-12 14:52:40,907 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0027 State change from FINISHING to FINISHED
2015-02-12 14:52:40,907 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0027_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:40,907 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0027_000001
2015-02-12 14:52:40,907 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0027
2015-02-12 14:52:40,908 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0027,name=[D4F28AE7EF8A49DEAAFC926E8C8A9571/4135E92F1C804F369F432D1B0EFAE62A] lower*upper/(1/1) ...nnerouternull-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0027/jobhistory/job/job_1423780884992_0027,appMasterHost=10.1.1.67,startTime=1423781530446,finishTime=1423781554152,finalStatus=SUCCEEDED
2015-02-12 14:52:40,907 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0027_000001 released container container_1423780884992_0027_01_000001 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:40,908 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:40,909 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:40,909 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000004
2015-02-12 14:52:40,909 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:40,909 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0027_000001 is done. finalState=FINISHED
2015-02-12 14:52:40,909 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0027 requests cleared
2015-02-12 14:52:40,910 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0027_000001 (auth:SIMPLE)
2015-02-12 14:52:40,912 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0027_01_000001
2015-02-12 14:52:40,912 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0027 CONTAINERID=container_1423780884992_0027_01_000001
2015-02-12 14:52:40,912 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0027_01_000001]
2015-02-12 14:52:40,912 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:40,912 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:40,913 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:40,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:40,913 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:40,913 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000005
2015-02-12 14:52:40,913 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:52:40,914 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:40,914 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0027
2015-02-12 14:52:40,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:40,914 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:40,914 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:40,915 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0027, with delay of 10800 seconds
2015-02-12 14:52:41,013 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742128_1304 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742128 for deletion
2015-02-12 14:52:41,013 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122 for deletion
2015-02-12 14:52:41,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123 for deletion
2015-02-12 14:52:41,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742128_1304 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742128
2015-02-12 14:52:41,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742124 for deletion
2015-02-12 14:52:41,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123
2015-02-12 14:52:41,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742125 for deletion
2015-02-12 14:52:41,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122
2015-02-12 14:52:41,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742125
2015-02-12 14:52:41,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742126 for deletion
2015-02-12 14:52:41,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742124
2015-02-12 14:52:41,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742127_1303 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742127 for deletion
2015-02-12 14:52:41,016 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742126
2015-02-12 14:52:41,016 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742127_1303 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742127
2015-02-12 14:52:41,458 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:41,458 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:41,458 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,458 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000006
2015-02-12 14:52:41,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,460 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0027
2015-02-12 14:52:41,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,459 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:41,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,460 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:41,461 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0027, with delay of 10800 seconds
2015-02-12 14:52:41,528 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0028_01_000002
2015-02-12 14:52:41,528 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:41,529 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0028_01_000003
2015-02-12 14:52:41,529 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:41,530 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0028_01_000004
2015-02-12 14:52:41,530 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:41,531 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:41,531 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0028_01_000006
2015-02-12 14:52:41,532 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:41,544 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312
2015-02-12 14:52:41,545 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310
2015-02-12 14:52:41,546 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308
2015-02-12 14:52:41,546 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305
2015-02-12 14:52:41,546 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306
2015-02-12 14:52:41,547 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311
2015-02-12 14:52:41,574 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:41,574 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,575 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0027
2015-02-12 14:52:41,575 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:41,575 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0027, with delay of 10800 seconds
2015-02-12 14:52:41,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,576 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:41,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:41,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:41,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122 for deletion
2015-02-12 14:52:41,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123 for deletion
2015-02-12 14:52:41,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742125 for deletion
2015-02-12 14:52:41,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742122
2015-02-12 14:52:41,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742125
2015-02-12 14:52:41,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742123
2015-02-12 14:52:41,649 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:52:41,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,652 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,653 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0027
2015-02-12 14:52:41,654 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,654 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0027
2015-02-12 14:52:41,654 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:52:41,654 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0027, with delay of 10800 seconds
2015-02-12 14:52:41,703 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:41,703 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:41,703 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:41,705 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:41,709 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000005 by user soberoi
2015-02-12 14:52:41,709 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0028
2015-02-12 14:52:41,710 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000005
2015-02-12 14:52:41,710 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from NEW to INITING
2015-02-12 14:52:41,710 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000005 to application application_1423780884992_0028
2015-02-12 14:52:41,710 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from INITING to RUNNING
2015-02-12 14:52:41,710 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:52:41,711 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,711 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,711 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:41,711 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0028
2015-02-12 14:52:41,711 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:41,711 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:41,711 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0028_01_000005
2015-02-12 14:52:41,716 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000004 by user soberoi
2015-02-12 14:52:41,716 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000004
2015-02-12 14:52:41,717 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000004 to application application_1423780884992_0028
2015-02-12 14:52:41,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000003 by user soberoi
2015-02-12 14:52:41,717 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:52:41,717 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0028
2015-02-12 14:52:41,717 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,717 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:41,717 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000003
2015-02-12 14:52:41,718 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from NEW to INITING
2015-02-12 14:52:41,718 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000003 to application application_1423780884992_0028
2015-02-12 14:52:41,717 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0028
2015-02-12 14:52:41,718 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from INITING to RUNNING
2015-02-12 14:52:41,718 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0028_01_000004
2015-02-12 14:52:41,718 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:52:41,718 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,718 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,718 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:41,719 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0028
2015-02-12 14:52:41,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:41,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:41,719 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0028_01_000003
2015-02-12 14:52:41,727 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000006 by user soberoi
2015-02-12 14:52:41,727 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0028
2015-02-12 14:52:41,728 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000006
2015-02-12 14:52:41,728 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from NEW to INITING
2015-02-12 14:52:41,728 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000006 to application application_1423780884992_0028
2015-02-12 14:52:41,728 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from INITING to RUNNING
2015-02-12 14:52:41,728 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:52:41,728 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,728 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,728 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:41,729 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0028
2015-02-12 14:52:41,729 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:41,729 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:41,730 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0028_01_000006
2015-02-12 14:52:41,733 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309
2015-02-12 14:52:41,734 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310
2015-02-12 14:52:41,735 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307
2015-02-12 14:52:41,736 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308
2015-02-12 14:52:41,736 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311
2015-02-12 14:52:41,738 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0028_01_000005.tokens. Credentials list:
2015-02-12 14:52:41,742 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0028_01_000003.tokens. Credentials list:
2015-02-12 14:52:41,746 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0028_01_000004.tokens. Credentials list:
2015-02-12 14:52:41,753 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0028_01_000006.tokens. Credentials list:
2015-02-12 14:52:41,764 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:41,782 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000002 by user soberoi
2015-02-12 14:52:41,783 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000002
2015-02-12 14:52:41,784 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000002 to application application_1423780884992_0028
2015-02-12 14:52:41,784 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:52:41,784 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,784 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0028
2015-02-12 14:52:41,784 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:41,785 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0028
2015-02-12 14:52:41,785 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:41,865 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:41,865 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:41,913 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:41,914 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:41,914 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:41,945 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309
2015-02-12 14:52:41,969 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:41,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:41,985 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:42,165 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000002/default_container_executor.sh]
2015-02-12 14:52:42,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0028_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000006.tokens
2015-02-12 14:52:42,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:52:42,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0028_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000003.tokens
2015-02-12 14:52:42,212 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:52:42,223 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0028_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000005.tokens
2015-02-12 14:52:42,223 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:52:42,357 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312
2015-02-12 14:52:42,358 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310
2015-02-12 14:52:42,359 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306
2015-02-12 14:52:42,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742135_1311
2015-02-12 14:52:42,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307
2015-02-12 14:52:42,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305
2015-02-12 14:52:42,373 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742129_1305
2015-02-12 14:52:42,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:42,374 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742130_1306
2015-02-12 14:52:42,374 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742134_1310
2015-02-12 14:52:42,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:42,376 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309
2015-02-12 14:52:42,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:42,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:42,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:42,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:42,457 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0028/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:42,459 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:42,460 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0028/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:42,472 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0028/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:42,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:42,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:42,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:42,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:42,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:42,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:42,550 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:52:42,566 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0028/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:42,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:42,566 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:42,567 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:42,566 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0028/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:42,578 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742132_1308
2015-02-12 14:52:42,579 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:42,580 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742136_1312
2015-02-12 14:52:42,589 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0028/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:42,590 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:42,648 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:42,648 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:42,651 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:42,651 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:42,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:42,654 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:42,654 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:42,657 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:42,658 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:42,777 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742131_1307
2015-02-12 14:52:42,845 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000006/default_container_executor.sh]
2015-02-12 14:52:42,845 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000004/default_container_executor.sh]
2015-02-12 14:52:42,846 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000003/default_container_executor.sh]
2015-02-12 14:52:42,862 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000005/default_container_executor.sh]
2015-02-12 14:52:43,599 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:43,737 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0028_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000004.tokens
2015-02-12 14:52:43,737 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:52:46,742 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314
2015-02-12 14:52:46,950 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313
2015-02-12 14:52:47,368 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314
2015-02-12 14:52:47,369 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313
2015-02-12 14:52:47,572 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742133_1309
2015-02-12 14:52:47,786 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742138_1314
2015-02-12 14:52:47,787 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742137_1313
2015-02-12 14:52:51,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:51,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:51,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:51,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:51,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:51,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:51,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:51,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:51,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:51,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:52,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:52,103 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:52,105 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000002
2015-02-12 14:52:52,106 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000002
2015-02-12 14:52:52,106 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:52:52,107 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000002
2015-02-12 14:52:52,132 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:52:52,132 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 2499 Total time for transactions(ms): 212 Number of transactions batched in Syncs: 9 Number of syncs: 1727 SyncTimes(ms): 579 415
2015-02-12 14:52:52,138 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315 src: /127.0.0.1:53770 dest: /127.0.0.1:50539
2015-02-12 14:52:52,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315 src: /127.0.0.1:53771 dest: /127.0.0.1:50546
2015-02-12 14:52:52,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315 src: /127.0.0.1:53772 dest: /127.0.0.1:50549
2015-02-12 14:52:52,144 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0028_01_000002 is : 143
2015-02-12 14:52:52,182 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist for DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:52,190 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:52,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000002
2015-02-12 14:52:52,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000002
2015-02-12 14:52:52,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000002
2015-02-12 14:52:52,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000002
2015-02-12 14:52:52,192 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000002
2015-02-12 14:52:52,192 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:52,193 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000002 from application application_1423780884992_0028
2015-02-12 14:52:52,193 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:52,193 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:52:52,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:52:52,468 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:52,470 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000006
2015-02-12 14:52:52,470 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000006
2015-02-12 14:52:52,470 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:52:52,471 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000006
2015-02-12 14:52:52,491 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0028_01_000006 is : 143
2015-02-12 14:52:52,501 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:52,502 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000006
2015-02-12 14:52:52,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000006
2015-02-12 14:52:52,504 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000006
2015-02-12 14:52:52,504 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000006
2015-02-12 14:52:52,505 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000006
2015-02-12 14:52:52,505 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:52,506 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000006 from application application_1423780884992_0028
2015-02-12 14:52:52,506 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:52,506 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:52:52,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:52:52,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:52:52,584 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:52,586 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000004
2015-02-12 14:52:52,586 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000004
2015-02-12 14:52:52,586 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:52:52,586 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000004
2015-02-12 14:52:52,610 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0028_01_000004 is : 143
2015-02-12 14:52:52,618 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:52,619 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000004
2015-02-12 14:52:52,620 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000004
2015-02-12 14:52:52,620 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000004
2015-02-12 14:52:52,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000004
2015-02-12 14:52:52,621 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000004
2015-02-12 14:52:52,621 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:52,621 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000004 from application application_1423780884992_0028
2015-02-12 14:52:52,621 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:52,621 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:52:52,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:52:52,644 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:52,646 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000003
2015-02-12 14:52:52,646 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000003
2015-02-12 14:52:52,646 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:52:52,647 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000003
2015-02-12 14:52:52,673 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0028_01_000003 is : 143
2015-02-12 14:52:52,689 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:52,690 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000003
2015-02-12 14:52:52,690 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000003
2015-02-12 14:52:52,690 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000003
2015-02-12 14:52:52,692 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000003
2015-02-12 14:52:52,694 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000003
2015-02-12 14:52:52,695 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:52,695 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000003 from application application_1423780884992_0028
2015-02-12 14:52:52,695 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:52,695 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:52:52,702 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:52,705 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000005
2015-02-12 14:52:52,705 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000005
2015-02-12 14:52:52,707 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:52,707 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:52:52,707 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000004
2015-02-12 14:52:52,707 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:52:52,707 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000004 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:52:52,708 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:52:52,708 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000005
2015-02-12 14:52:52,727 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0028_01_000005 is : 143
2015-02-12 14:52:52,743 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:52,745 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000005
2015-02-12 14:52:52,748 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000005
2015-02-12 14:52:52,751 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000005
2015-02-12 14:52:52,751 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000005
2015-02-12 14:52:52,752 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000005
2015-02-12 14:52:52,752 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:52,752 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000005 from application application_1423780884992_0028
2015-02-12 14:52:52,753 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:52,753 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:52:53,114 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:53,114 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:52:53,114 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000002
2015-02-12 14:52:53,114 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:52:53,114 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000002 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:52:53,473 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:53,473 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:52:53,473 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000006
2015-02-12 14:52:53,474 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:53,474 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000006 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:53,654 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:53,654 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:52:53,655 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000003
2015-02-12 14:52:53,655 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:53,655 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:53,656 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:53,656 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000007
2015-02-12 14:52:53,656 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0028_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:52:53,709 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:53,709 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:53,709 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:52:53,709 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000005
2015-02-12 14:52:53,709 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:53,709 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000005 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:54,118 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:54,478 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:54,606 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:54,617 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:54,619 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0028_01_000007 by user soberoi
2015-02-12 14:52:54,620 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000007
2015-02-12 14:52:54,620 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0028_01_000007 to application application_1423780884992_0028
2015-02-12 14:52:54,620 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:52:54,620 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0028
2015-02-12 14:52:54,620 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0028
2015-02-12 14:52:54,620 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:52:54,621 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0028
2015-02-12 14:52:54,621 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:52:54,654 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:52:54,654 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:54,658 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:52:54,658 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:54,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0028_01_000004]
2015-02-12 14:52:54,710 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:54,710 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:54,759 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000007/default_container_executor.sh]
2015-02-12 14:52:55,122 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0028_01_000002]
2015-02-12 14:52:55,122 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:55,483 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0028_01_000006]
2015-02-12 14:52:55,484 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:55,612 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:52:55,660 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0028_01_000003]
2015-02-12 14:52:55,660 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:55,711 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0028_01_000005]
2015-02-12 14:52:55,711 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:57,248 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:57,251 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:57,254 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:57,256 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:57,266 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:52:57,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,571 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:52:57,675 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316 src: /127.0.0.1:53787 dest: /127.0.0.1:50539
2015-02-12 14:52:57,677 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316 src: /127.0.0.1:53788 dest: /127.0.0.1:50543
2015-02-12 14:52:57,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316 src: /127.0.0.1:53789 dest: /127.0.0.1:50546
2015-02-12 14:52:57,717 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53789, dest: /127.0.0.1:50546, bytes: 239, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0028_r_000000_0_1918159902_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316, duration: 37825000
2015-02-12 14:52:57,718 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:57,718 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53788, dest: /127.0.0.1:50543, bytes: 239, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0028_r_000000_0_1918159902_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316, duration: 38528000
2015-02-12 14:52:57,719 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,718 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,719 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53787, dest: /127.0.0.1:50539, bytes: 239, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0028_r_000000_0_1918159902_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316, duration: 39648000
2015-02-12 14:52:57,720 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,721 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,723 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,728 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0028_r_000000_0_1918159902_1
2015-02-12 14:52:57,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:57,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:52:57,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/task_1423780884992_0028_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:52:57,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/_temporary/attempt_1423780884992_0028_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/task_1423780884992_0028_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:52:57,779 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:52:57,788 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000007
2015-02-12 14:52:57,788 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000007
2015-02-12 14:52:57,788 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:52:57,788 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000007
2015-02-12 14:52:57,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,805 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:52:57,818 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0028_01_000007 is : 143
2015-02-12 14:52:57,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:57,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:57,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/task_1423780884992_0028_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:52:57,832 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:52:57,832 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000007
2015-02-12 14:52:57,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:57,833 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000007
2015-02-12 14:52:57,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary/1/task_1423780884992_0028_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,837 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000007
2015-02-12 14:52:57,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000007
2015-02-12 14:52:57,840 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000007
2015-02-12 14:52:57,840 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:52:57,841 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000007 from application application_1423780884992_0028
2015-02-12 14:52:57,841 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:52:57,841 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:52:57,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:52:57,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,848 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_SUCCESS is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,852 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,872 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53772, dest: /127.0.0.1:50549, bytes: 69225, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315, duration: 5726439000
2015-02-12 14:52:57,873 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:57,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16376
2015-02-12 14:52:57,874 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53771, dest: /127.0.0.1:50546, bytes: 69225, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315, duration: 5714314000
2015-02-12 14:52:57,875 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,876 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16376
2015-02-12 14:52:57,876 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53770, dest: /127.0.0.1:50539, bytes: 69225, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315, duration: 5716281000
2015-02-12 14:52:57,877 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742139_1315, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 16376
2015-02-12 14:52:57,880 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,886 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:52:57,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317 src: /127.0.0.1:53791 dest: /127.0.0.1:50539
2015-02-12 14:52:57,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317 src: /127.0.0.1:53792 dest: /127.0.0.1:50543
2015-02-12 14:52:57,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317 src: /127.0.0.1:53793 dest: /127.0.0.1:50549
2015-02-12 14:52:57,895 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53793, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317, duration: 1414000
2015-02-12 14:52:57,896 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:57,896 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53792, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317, duration: 2183000
2015-02-12 14:52:57,896 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,896 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,897 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53791, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317, duration: 3166000
2015-02-12 14:52:57,897 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,897 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,898 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,899 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary_tmp is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:57,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:57,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:57,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:57,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:57,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:52:57,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,932 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:52:57,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318 src: /127.0.0.1:53795 dest: /127.0.0.1:50539
2015-02-12 14:52:57,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318 src: /127.0.0.1:53796 dest: /127.0.0.1:50549
2015-02-12 14:52:57,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318 src: /127.0.0.1:53797 dest: /127.0.0.1:50546
2015-02-12 14:52:57,951 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53797, dest: /127.0.0.1:50546, bytes: 69225, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318, duration: 12263000
2015-02-12 14:52:57,951 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:57,951 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,952 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53796, dest: /127.0.0.1:50549, bytes: 69225, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318, duration: 12893000
2015-02-12 14:52:57,952 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,952 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53795, dest: /127.0.0.1:50539, bytes: 69225, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318, duration: 13718000
2015-02-12 14:52:57,952 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,958 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:57,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:57,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:57,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:57,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:52:57,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028/job_1423780884992_0028_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:52:57,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:52:57,979 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:52:57,982 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319 src: /127.0.0.1:53799 dest: /127.0.0.1:50543
2015-02-12 14:52:57,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319 src: /127.0.0.1:53800 dest: /127.0.0.1:50546
2015-02-12 14:52:57,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319 src: /127.0.0.1:53801 dest: /127.0.0.1:50539
2015-02-12 14:52:57,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53801, dest: /127.0.0.1:50539, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319, duration: 1954000
2015-02-12 14:52:57,988 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:57,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:52:57,989 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53800, dest: /127.0.0.1:50546, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319, duration: 2340000
2015-02-12 14:52:57,989 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,990 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:52:57,990 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53799, dest: /127.0.0.1:50543, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_601111562_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319, duration: 3402000
2015-02-12 14:52:57,990 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:57,991 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:57,992 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_601111562_1
2015-02-12 14:52:57,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:57,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:57,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:58,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:52:58,011 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0028_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:52:58,011 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:52:58,011 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0028 with final state: FINISHING
2015-02-12 14:52:58,011 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from RUNNING to FINAL_SAVING
2015-02-12 14:52:58,011 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0028
2015-02-12 14:52:58,012 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:52:58,012 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from FINAL_SAVING to FINISHING
2015-02-12 14:52:58,795 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:52:58,795 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:52:58,795 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000007
2015-02-12 14:52:58,796 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:52:58,796 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000007 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:52:59,016 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0028 unregistered successfully.
2015-02-12 14:52:59,020 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742133_1309 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:52:59,020 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742134_1310 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:52:59,020 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742135_1311 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:52:59,020 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742136_1312 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:52:59,021 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742138_1314 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:52:59,021 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742139_1315 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:52:59,021 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742137_1313 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:52:59,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0028 dst=null perm=null proto=rpc
2015-02-12 14:52:59,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,067 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary
2015-02-12 14:52:59,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:52:59,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,084 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:59,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:59,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:52:59,107 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:59,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:52:59,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,131 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:52:59,131 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:52:59,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:59,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:52:59,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:52:59,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:52:59,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup"]
2015-02-12 14:52:59,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:52:59,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:52:59,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:52:59,145 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...roupouternull-resultgroup
2015-02-12 14:52:59,159 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:52:59,173 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:52:59,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:52:59,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:59,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:52:59,179 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 29
2015-02-12 14:52:59,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029 dst=null perm=null proto=rpc
2015-02-12 14:52:59,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:52:59,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:52:59,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,186 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:52:59,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 src: /127.0.0.1:53805 dest: /127.0.0.1:50543
2015-02-12 14:52:59,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 src: /127.0.0.1:53806 dest: /127.0.0.1:50549
2015-02-12 14:52:59,192 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 src: /127.0.0.1:53807 dest: /127.0.0.1:50546
2015-02-12 14:52:59,197 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53807, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320, duration: 2344000
2015-02-12 14:52:59,198 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:59,198 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:52:59,200 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53806, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320, duration: 3693000
2015-02-12 14:52:59,200 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,202 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53805, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320, duration: 6347000
2015-02-12 14:52:59,202 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:52:59,202 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,204 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:52:59,207 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:59,208 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar
2015-02-12 14:52:59,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:52:59,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:52:59,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:52:59,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:52:59,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:52:59,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,221 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:59,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,223 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:59,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,225 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:59,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,228 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:52:59,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:52:59,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,235 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split
2015-02-12 14:52:59,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:59,236 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:52:59,238 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321 src: /127.0.0.1:53808 dest: /127.0.0.1:50539
2015-02-12 14:52:59,239 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321 src: /127.0.0.1:53809 dest: /127.0.0.1:50546
2015-02-12 14:52:59,242 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321 src: /127.0.0.1:53810 dest: /127.0.0.1:50543
2015-02-12 14:52:59,244 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321 src: /127.0.0.1:53811 dest: /127.0.0.1:50549
2015-02-12 14:52:59,247 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53811, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, duration: 1756000
2015-02-12 14:52:59,248 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:59,248 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:52:59,249 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53810, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, duration: 3062000
2015-02-12 14:52:59,250 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,251 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53809, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, duration: 5127000
2015-02-12 14:52:59,251 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,252 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,253 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53808, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, duration: 7268000
2015-02-12 14:52:59,254 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,254 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,257 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:59,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,264 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:52:59,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322 src: /127.0.0.1:53812 dest: /127.0.0.1:50539
2015-02-12 14:52:59,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322 src: /127.0.0.1:53813 dest: /127.0.0.1:50543
2015-02-12 14:52:59,268 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322 src: /127.0.0.1:53814 dest: /127.0.0.1:50549
2015-02-12 14:52:59,271 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53814, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322, duration: 1312000
2015-02-12 14:52:59,271 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:59,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,272 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53813, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322, duration: 2600000
2015-02-12 14:52:59,272 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,273 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53812, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322, duration: 3701000
2015-02-12 14:52:59,274 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,274 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,276 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,277 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:59,278 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:52:59,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:52:59,286 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:52:59,288 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323 src: /127.0.0.1:53815 dest: /127.0.0.1:50546
2015-02-12 14:52:59,290 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323 src: /127.0.0.1:53816 dest: /127.0.0.1:50549
2015-02-12 14:52:59,291 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323 src: /127.0.0.1:53817 dest: /127.0.0.1:50539
2015-02-12 14:52:59,294 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53817, dest: /127.0.0.1:50539, bytes: 98364, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323, duration: 1800000
2015-02-12 14:52:59,295 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:52:59,295 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,296 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53816, dest: /127.0.0.1:50549, bytes: 98364, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323, duration: 2553000
2015-02-12 14:52:59,296 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,297 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53815, dest: /127.0.0.1:50546, bytes: 98364, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323, duration: 3958000
2015-02-12 14:52:59,297 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:52:59,297 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,298 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:52:59,299 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:52:59,299 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0029
2015-02-12 14:52:59,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029 dst=null perm=null proto=rpc
2015-02-12 14:52:59,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:59,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:52:59,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:59,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:59,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:59,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:59,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,314 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 29 submitted by user soberoi
2015-02-12 14:52:59,315 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0029
2015-02-12 14:52:59,315 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0029
2015-02-12 14:52:59,315 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from NEW to NEW_SAVING
2015-02-12 14:52:59,315 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0029
2015-02-12 14:52:59,316 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:52:59,316 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0029 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:52:59,317 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from SUBMITTED to ACCEPTED
2015-02-12 14:52:59,317 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0029
2015-02-12 14:52:59,317 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0029_000001
2015-02-12 14:52:59,318 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from NEW to SUBMITTED
2015-02-12 14:52:59,318 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0029_000001 to scheduler from user: soberoi
2015-02-12 14:52:59,318 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:52:59,322 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0029/
2015-02-12 14:52:59,322 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0029
2015-02-12 14:52:59,322 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0029/
2015-02-12 14:52:59,501 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:52:59,501 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000001
2015-02-12 14:52:59,502 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:52:59,502 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0029_01_000001
2015-02-12 14:52:59,502 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:52:59,502 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0029_000001
2015-02-12 14:52:59,502 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0029 AttemptId: appattempt_1423780884992_0029_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0029_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:52:59,502 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:52:59,503 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:52:59,503 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0029_000001
2015-02-12 14:52:59,506 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0029_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0029_000001
2015-02-12 14:52:59,506 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0029_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:52:59,506 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0029_000001
2015-02-12 14:52:59,506 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0029_000001
2015-02-12 14:52:59,508 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:52:59,511 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000001 by user soberoi
2015-02-12 14:52:59,511 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0029
2015-02-12 14:52:59,511 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000001
2015-02-12 14:52:59,511 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from NEW to INITING
2015-02-12 14:52:59,511 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000001 to application application_1423780884992_0029
2015-02-12 14:52:59,511 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from INITING to RUNNING
2015-02-12 14:52:59,511 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0029_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0029_000001
2015-02-12 14:52:59,512 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:52:59,512 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:52:59,512 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:52:59,512 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:52:59,512 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:52:59,512 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:52:59,512 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:52:59,513 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0029_01_000001
2015-02-12 14:52:59,525 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0029_01_000001.tokens. Credentials list:
2015-02-12 14:52:59,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:52:59,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0029_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000001.tokens
2015-02-12 14:52:59,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:52:59,800 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:52:59,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:52:59,869 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:59,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:59,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:52:59,941 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0029/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:52:59,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:52:59,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:00,008 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:00,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:00,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:00,102 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0029/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:00,102 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:00,160 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:00,161 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:00,286 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000001/default_container_executor.sh]
2015-02-12 14:53:00,501 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:00,800 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:01,217 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742144_1320 to datanode(s) 127.0.0.1:50539
2015-02-12 14:53:01,217 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742133_1309, blk_1073742134_1310, blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313]
2015-02-12 14:53:01,217 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742133_1309, blk_1073742134_1310, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742139_1315]
2015-02-12 14:53:01,804 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133 for deletion
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134 for deletion
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742135 for deletion
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742136 for deletion
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742137 for deletion
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134
2015-02-12 14:53:02,028 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742135
2015-02-12 14:53:02,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742136
2015-02-12 14:53:02,029 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742137
2015-02-12 14:53:02,377 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 to 127.0.0.1:50539
2015-02-12 14:53:02,378 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 src: /127.0.0.1:53824 dest: /127.0.0.1:50539
2015-02-12 14:53:02,379 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:53:02,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320 src: /127.0.0.1:53824 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:53:02,381 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742144_1320 size 254067
2015-02-12 14:53:02,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:02,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:53:02,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:53:02,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:53:02,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029 dst=null perm=null proto=rpc
2015-02-12 14:53:02,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:53:02,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133 for deletion
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134 for deletion
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742136 for deletion
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742137 for deletion
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742136
2015-02-12 14:53:02,642 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742138 for deletion
2015-02-12 14:53:02,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742139 for deletion
2015-02-12 14:53:02,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742137
2015-02-12 14:53:02,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742138
2015-02-12 14:53:02,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742139
2015-02-12 14:53:02,808 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:02,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:02,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:03,809 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:03,848 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:03,852 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0029_000001
2015-02-12 14:53:03,853 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0029 APPATTEMPTID=appattempt_1423780884992_0029_000001
2015-02-12 14:53:03,853 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:53:03,853 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from ACCEPTED to RUNNING
2015-02-12 14:53:03,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:03,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:53:04,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:04,082 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0028_01_000001 succeeded
2015-02-12 14:53:04,082 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:53:04,082 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0028_01_000001
2015-02-12 14:53:04,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000001
2015-02-12 14:53:04,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000001
2015-02-12 14:53:04,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000001
2015-02-12 14:53:04,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0028/container_1423780884992_0028_01_000001
2015-02-12 14:53:04,117 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000001
2015-02-12 14:53:04,117 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0028_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:53:04,118 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0028_01_000001 from application application_1423780884992_0028
2015-02-12 14:53:04,118 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:04,118 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0028
2015-02-12 14:53:04,145 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0028_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:04,145 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0028_000001
2015-02-12 14:53:04,145 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0028_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:53:04,145 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000001
2015-02-12 14:53:04,145 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0028_000001
2015-02-12 14:53:04,146 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0028_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:04,146 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0028_000001 State change from FINISHING to FINISHED
2015-02-12 14:53:04,146 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0028_000001 released container container_1423780884992_0028_01_000001 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:04,146 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0028 State change from FINISHING to FINISHED
2015-02-12 14:53:04,146 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0028_000001 is done. finalState=FINISHED
2015-02-12 14:53:04,146 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0028_000001
2015-02-12 14:53:04,146 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0028 requests cleared
2015-02-12 14:53:04,146 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0028
2015-02-12 14:53:04,147 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0028,name=[E15B188C0EB4483FADA8AEC7B9307695/79666561EECD488EBA095188FDCE15A2] lower*upper/(1/1) ...platform/cogroupouternull,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0028/jobhistory/job/job_1423780884992_0028,appMasterHost=10.1.1.67,startTime=1423781555510,finishTime=1423781578011,finalStatus=SUCCEEDED
2015-02-12 14:53:04,149 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0028_000001 (auth:SIMPLE)
2015-02-12 14:53:04,150 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0028_01_000001
2015-02-12 14:53:04,151 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0028 CONTAINERID=container_1423780884992_0028_01_000001
2015-02-12 14:53:04,151 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0028_01_000001]
2015-02-12 14:53:04,151 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:04,151 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:04,152 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,152 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,153 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,153 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,153 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0028
2015-02-12 14:53:04,154 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:04,155 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0028, with delay of 10800 seconds
2015-02-12 14:53:04,219 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742133_1309, blk_1073742134_1310, blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742139_1315]
2015-02-12 14:53:04,219 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742133_1309, blk_1073742134_1310, blk_1073742135_1311, blk_1073742138_1314, blk_1073742139_1315]
2015-02-12 14:53:04,390 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:53:04,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324 src: /127.0.0.1:53833 dest: /127.0.0.1:50543
2015-02-12 14:53:04,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324 src: /127.0.0.1:53834 dest: /127.0.0.1:50549
2015-02-12 14:53:04,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324 src: /127.0.0.1:53835 dest: /127.0.0.1:50546
2015-02-12 14:53:04,491 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53835, dest: /127.0.0.1:50546, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324, duration: 40102000
2015-02-12 14:53:04,492 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:04,493 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:53:04,493 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53834, dest: /127.0.0.1:50549, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324, duration: 41264000
2015-02-12 14:53:04,493 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:04,493 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:04,494 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53833, dest: /127.0.0.1:50543, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324, duration: 42948000
2015-02-12 14:53:04,495 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:04,495 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:04,513 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:04,514 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:04,515 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,515 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,515 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,515 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0028
2015-02-12 14:53:04,515 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,516 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:04,516 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0028, with delay of 10800 seconds
2015-02-12 14:53:04,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:04,558 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:53:04,560 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325 src: /127.0.0.1:53836 dest: /127.0.0.1:50543
2015-02-12 14:53:04,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325 src: /127.0.0.1:53837 dest: /127.0.0.1:50549
2015-02-12 14:53:04,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325 src: /127.0.0.1:53838 dest: /127.0.0.1:50539
2015-02-12 14:53:04,571 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53838, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325, duration: 1346000
2015-02-12 14:53:04,571 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:04,572 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:53:04,572 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53837, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325, duration: 2580000
2015-02-12 14:53:04,572 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:04,573 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:04,573 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53836, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325, duration: 3703000
2015-02-12 14:53:04,573 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:04,573 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:04,575 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029.summary is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:04,739 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:04,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,740 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0028
2015-02-12 14:53:04,741 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:04,741 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0028, with delay of 10800 seconds
2015-02-12 14:53:04,812 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:04,812 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:04,813 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,813 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0028
2015-02-12 14:53:04,814 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0028
2015-02-12 14:53:04,814 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:04,814 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0028, with delay of 10800 seconds
2015-02-12 14:53:05,061 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133 for deletion
2015-02-12 14:53:05,061 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134 for deletion
2015-02-12 14:53:05,061 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742135 for deletion
2015-02-12 14:53:05,062 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742138 for deletion
2015-02-12 14:53:05,062 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133
2015-02-12 14:53:05,062 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134
2015-02-12 14:53:05,062 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742139 for deletion
2015-02-12 14:53:05,062 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742138
2015-02-12 14:53:05,062 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742135
2015-02-12 14:53:05,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742139
2015-02-12 14:53:05,153 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:05,154 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000002
2015-02-12 14:53:05,154 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:53:05,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133 for deletion
2015-02-12 14:53:05,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134 for deletion
2015-02-12 14:53:05,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742135 for deletion
2015-02-12 14:53:05,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742133_1309 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742133
2015-02-12 14:53:05,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742134_1310 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742134
2015-02-12 14:53:05,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742136 for deletion
2015-02-12 14:53:05,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742135
2015-02-12 14:53:05,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742137 for deletion
2015-02-12 14:53:05,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742138 for deletion
2015-02-12 14:53:05,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742136
2015-02-12 14:53:05,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742139 for deletion
2015-02-12 14:53:05,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742138
2015-02-12 14:53:05,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742137
2015-02-12 14:53:05,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742139
2015-02-12 14:53:05,515 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:05,515 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000003
2015-02-12 14:53:05,516 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:53:05,739 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:05,740 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000004
2015-02-12 14:53:05,740 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:53:05,816 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:05,817 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:05,818 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000005
2015-02-12 14:53:05,818 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:53:05,956 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0029_01_000002
2015-02-12 14:53:05,956 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:05,956 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0029_01_000003
2015-02-12 14:53:05,957 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:05,957 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0029_01_000004
2015-02-12 14:53:05,957 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:05,958 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0029_01_000005
2015-02-12 14:53:05,958 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:05,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,109 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:06,109 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:06,109 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:06,109 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:06,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000003 by user soberoi
2015-02-12 14:53:06,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000004 by user soberoi
2015-02-12 14:53:06,113 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000003
2015-02-12 14:53:06,113 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0029
2015-02-12 14:53:06,113 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000002 by user soberoi
2015-02-12 14:53:06,113 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000004
2015-02-12 14:53:06,113 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0029
2015-02-12 14:53:06,113 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000002
2015-02-12 14:53:06,113 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from NEW to INITING
2015-02-12 14:53:06,113 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000004 to application application_1423780884992_0029
2015-02-12 14:53:06,114 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from INITING to RUNNING
2015-02-12 14:53:06,114 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from NEW to INITING
2015-02-12 14:53:06,114 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000002 to application application_1423780884992_0029
2015-02-12 14:53:06,114 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:53:06,114 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,114 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,114 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:06,114 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from INITING to RUNNING
2015-02-12 14:53:06,115 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0029
2015-02-12 14:53:06,115 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:53:06,115 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,115 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,115 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:06,115 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0029
2015-02-12 14:53:06,115 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:06,115 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:06,115 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0029_01_000002
2015-02-12 14:53:06,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000005 by user soberoi
2015-02-12 14:53:06,116 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0029
2015-02-12 14:53:06,116 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000005
2015-02-12 14:53:06,115 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:06,117 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:06,117 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0029_01_000004
2015-02-12 14:53:06,117 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from NEW to INITING
2015-02-12 14:53:06,117 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000005 to application application_1423780884992_0029
2015-02-12 14:53:06,118 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from INITING to RUNNING
2015-02-12 14:53:06,118 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:53:06,118 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,118 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,118 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:06,118 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0029
2015-02-12 14:53:06,119 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:06,119 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:06,119 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0029_01_000005
2015-02-12 14:53:06,113 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000003 to application application_1423780884992_0029
2015-02-12 14:53:06,120 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:53:06,120 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,120 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,120 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:06,120 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0029
2015-02-12 14:53:06,120 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:06,141 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0029_01_000002.tokens. Credentials list:
2015-02-12 14:53:06,141 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0029_01_000005.tokens. Credentials list:
2015-02-12 14:53:06,142 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0029_01_000004.tokens. Credentials list:
2015-02-12 14:53:06,154 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:06,154 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:06,154 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000006
2015-02-12 14:53:06,155 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:53:06,186 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:06,187 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:06,359 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:06,360 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:06,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:06,402 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000003/default_container_executor.sh]
2015-02-12 14:53:06,516 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:06,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0029_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000002.tokens
2015-02-12 14:53:06,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:06,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0029_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000005.tokens
2015-02-12 14:53:06,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:06,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0029_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000004.tokens
2015-02-12 14:53:06,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:06,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,740 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:06,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:06,758 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316
2015-02-12 14:53:06,759 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318
2015-02-12 14:53:06,760 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321
2015-02-12 14:53:06,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322
2015-02-12 14:53:06,762 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319
2015-02-12 14:53:06,762 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317
2015-02-12 14:53:06,815 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:06,821 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:06,826 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0029/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:06,830 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0029/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:06,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:06,930 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0029/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:06,930 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:06,930 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:06,930 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0029/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:06,932 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:06,932 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:06,962 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323
2015-02-12 14:53:06,967 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319
2015-02-12 14:53:06,968 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:06,978 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:06,980 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000006 by user soberoi
2015-02-12 14:53:06,980 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000006
2015-02-12 14:53:06,980 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000006 to application application_1423780884992_0029
2015-02-12 14:53:06,981 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:53:06,981 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,981 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0029
2015-02-12 14:53:06,981 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:06,981 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0029
2015-02-12 14:53:06,981 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:06,987 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:06,987 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:07,002 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:07,002 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:07,004 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:07,004 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:07,039 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:07,039 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:07,156 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:07,156 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:07,156 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000007
2015-02-12 14:53:07,156 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:53:07,171 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320
2015-02-12 14:53:07,172 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317
2015-02-12 14:53:07,172 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316
2015-02-12 14:53:07,172 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321
2015-02-12 14:53:07,173 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322
2015-02-12 14:53:07,252 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000004/default_container_executor.sh]
2015-02-12 14:53:07,266 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000002/default_container_executor.sh]
2015-02-12 14:53:07,269 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000005/default_container_executor.sh]
2015-02-12 14:53:07,282 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000006/default_container_executor.sh]
2015-02-12 14:53:07,588 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320
2015-02-12 14:53:07,589 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321
2015-02-12 14:53:07,589 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323
2015-02-12 14:53:07,793 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742143_1319
2015-02-12 14:53:07,794 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742140_1316
2015-02-12 14:53:07,794 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318
2015-02-12 14:53:07,804 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742146_1322
2015-02-12 14:53:07,804 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742141_1317
2015-02-12 14:53:07,805 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742142_1318
2015-02-12 14:53:07,975 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:53:07,976 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:08,009 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320
2015-02-12 14:53:08,010 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742145_1321
2015-02-12 14:53:08,011 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742147_1323
2015-02-12 14:53:08,978 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:53:08,978 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:53:08,978 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000007
2015-02-12 14:53:08,979 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:53:08,979 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000007 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:53:09,164 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0029_01_000007
2015-02-12 14:53:09,597 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30001 milliseconds
2015-02-12 14:53:09,598 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:53:11,971 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742144_1320
2015-02-12 14:53:11,972 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325
2015-02-12 14:53:12,178 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324
2015-02-12 14:53:12,178 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325
2015-02-12 14:53:12,801 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324
2015-02-12 14:53:13,019 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742149_1325
2015-02-12 14:53:13,020 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742148_1324
2015-02-12 14:53:15,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:15,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:15,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:15,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:15,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:15,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:53:16,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:53:16,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:53:16,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:53:16,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:53:16,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:53:16,487 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:16,489 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000003
2015-02-12 14:53:16,489 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000003
2015-02-12 14:53:16,489 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:53:16,490 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000003
2015-02-12 14:53:16,512 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:53:16,512 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0029_01_000003 is : 143
2015-02-12 14:53:16,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326 src: /127.0.0.1:53886 dest: /127.0.0.1:50543
2015-02-12 14:53:16,518 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326 src: /127.0.0.1:53887 dest: /127.0.0.1:50549
2015-02-12 14:53:16,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326 src: /127.0.0.1:53888 dest: /127.0.0.1:50546
2015-02-12 14:53:16,544 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:16,544 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000003
2015-02-12 14:53:16,545 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist for DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:16,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000003
2015-02-12 14:53:16,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000003
2015-02-12 14:53:16,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000003
2015-02-12 14:53:16,546 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000003
2015-02-12 14:53:16,547 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:16,553 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000003 from application application_1423780884992_0029
2015-02-12 14:53:16,553 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:16,553 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:16,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:53:16,756 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:16,757 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000002
2015-02-12 14:53:16,758 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000002
2015-02-12 14:53:16,758 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:53:16,758 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000002
2015-02-12 14:53:16,777 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0029_01_000002 is : 143
2015-02-12 14:53:16,788 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:16,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000002
2015-02-12 14:53:16,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000002
2015-02-12 14:53:16,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000002
2015-02-12 14:53:16,790 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000002
2015-02-12 14:53:16,790 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000002
2015-02-12 14:53:16,790 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:16,791 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000002 from application application_1423780884992_0029
2015-02-12 14:53:16,791 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:16,791 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:16,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:53:16,844 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:16,846 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000006
2015-02-12 14:53:16,846 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000006
2015-02-12 14:53:16,846 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:53:16,847 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000006
2015-02-12 14:53:16,847 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:16,848 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:53:16,848 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000002
2015-02-12 14:53:16,848 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:53:16,848 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000002 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:53:16,874 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0029_01_000006 is : 143
2015-02-12 14:53:16,887 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:16,887 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000006
2015-02-12 14:53:16,888 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000006
2015-02-12 14:53:16,888 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000006
2015-02-12 14:53:16,889 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000006
2015-02-12 14:53:16,890 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000006
2015-02-12 14:53:16,890 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:16,891 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000006 from application application_1423780884992_0029
2015-02-12 14:53:16,891 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:16,891 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:16,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:53:16,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:53:16,933 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:16,935 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000005
2015-02-12 14:53:16,935 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000005
2015-02-12 14:53:16,936 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:53:16,936 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000005
2015-02-12 14:53:16,954 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0029_01_000005 is : 143
2015-02-12 14:53:16,968 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:16,969 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000005
2015-02-12 14:53:16,969 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000005
2015-02-12 14:53:16,970 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000005
2015-02-12 14:53:16,972 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000005
2015-02-12 14:53:16,973 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000005
2015-02-12 14:53:16,973 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:16,974 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000005 from application application_1423780884992_0029
2015-02-12 14:53:16,974 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:16,974 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:16,984 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:16,986 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000004
2015-02-12 14:53:16,986 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000004
2015-02-12 14:53:16,986 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:53:16,987 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000004
2015-02-12 14:53:17,006 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0029_01_000004 is : 143
2015-02-12 14:53:17,021 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:17,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000004
2015-02-12 14:53:17,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000004
2015-02-12 14:53:17,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000004
2015-02-12 14:53:17,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000004
2015-02-12 14:53:17,027 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000004
2015-02-12 14:53:17,028 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:17,029 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000004 from application application_1423780884992_0029
2015-02-12 14:53:17,031 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:17,032 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:17,492 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:17,493 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:53:17,493 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000003
2015-02-12 14:53:17,493 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:53:17,493 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000003 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:53:17,851 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:17,851 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:17,851 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:53:17,852 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000006
2015-02-12 14:53:17,852 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:17,852 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000006 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:17,943 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:17,943 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:53:17,943 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000005
2015-02-12 14:53:17,943 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:17,944 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:17,989 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:17,989 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:53:17,989 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000004
2015-02-12 14:53:17,990 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:17,990 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:18,496 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:18,497 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:18,497 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000008
2015-02-12 14:53:18,497 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0029_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:53:18,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0029_01_000002]
2015-02-12 14:53:18,854 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:18,854 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:18,948 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:18,993 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:19,019 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:19,036 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:19,040 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0029_01_000008 by user soberoi
2015-02-12 14:53:19,041 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000008
2015-02-12 14:53:19,041 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0029_01_000008 to application application_1423780884992_0029
2015-02-12 14:53:19,041 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:53:19,041 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0029
2015-02-12 14:53:19,041 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0029
2015-02-12 14:53:19,041 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:19,042 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0029
2015-02-12 14:53:19,042 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:19,107 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:19,107 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:19,218 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000008/default_container_executor.sh]
2015-02-12 14:53:19,497 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0029_01_000003]
2015-02-12 14:53:19,498 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:19,498 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:19,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0029_01_000006]
2015-02-12 14:53:19,854 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:19,949 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0029_01_000005]
2015-02-12 14:53:19,949 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:19,995 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0029_01_000004]
2015-02-12 14:53:19,995 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:20,026 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:53:21,826 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:21,830 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:21,835 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:21,837 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:21,846 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:22,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,198 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:53:22,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327 src: /127.0.0.1:53902 dest: /127.0.0.1:50549
2015-02-12 14:53:22,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327 src: /127.0.0.1:53903 dest: /127.0.0.1:50546
2015-02-12 14:53:22,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327 src: /127.0.0.1:53904 dest: /127.0.0.1:50539
2015-02-12 14:53:22,358 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53904, dest: /127.0.0.1:50539, bytes: 239, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0029_r_000000_0_-1907384652_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327, duration: 52555000
2015-02-12 14:53:22,358 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:22,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:53:22,360 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53903, dest: /127.0.0.1:50546, bytes: 239, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0029_r_000000_0_-1907384652_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327, duration: 53534000
2015-02-12 14:53:22,360 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,361 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53902, dest: /127.0.0.1:50549, bytes: 239, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0029_r_000000_0_-1907384652_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327, duration: 55251000
2015-02-12 14:53:22,362 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:22,362 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,362 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:22,369 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0029_r_000000_0_-1907384652_1
2015-02-12 14:53:22,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:53:22,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:53:22,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/task_1423780884992_0029_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:53:22,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0029_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/task_1423780884992_0029_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:53:22,452 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:22,454 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000008
2015-02-12 14:53:22,454 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000008
2015-02-12 14:53:22,454 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:53:22,454 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000008
2015-02-12 14:53:22,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,466 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:53:22,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:22,484 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0029_01_000008 is : 143
2015-02-12 14:53:22,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:22,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/task_1423780884992_0029_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:53:22,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:22,492 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:22,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary/1/task_1423780884992_0029_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,493 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000008
2015-02-12 14:53:22,494 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000008
2015-02-12 14:53:22,494 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:22,495 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000008 from application application_1423780884992_0029
2015-02-12 14:53:22,495 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:22,495 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:22,496 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000008
2015-02-12 14:53:22,496 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000008
2015-02-12 14:53:22,497 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000008
2015-02-12 14:53:22,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:53:22,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,513 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,520 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,538 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53888, dest: /127.0.0.1:50546, bytes: 69220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326, duration: 6014623000
2015-02-12 14:53:22,538 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:22,539 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16374
2015-02-12 14:53:22,539 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53887, dest: /127.0.0.1:50549, bytes: 69220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326, duration: 6014483000
2015-02-12 14:53:22,540 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,541 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16374
2015-02-12 14:53:22,541 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53886, dest: /127.0.0.1:50543, bytes: 69220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326, duration: 6017802000
2015-02-12 14:53:22,541 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,542 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 16374
2015-02-12 14:53:22,543 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,550 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:53:22,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328 src: /127.0.0.1:53907 dest: /127.0.0.1:50546
2015-02-12 14:53:22,554 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328 src: /127.0.0.1:53908 dest: /127.0.0.1:50549
2015-02-12 14:53:22,556 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328 src: /127.0.0.1:53909 dest: /127.0.0.1:50539
2015-02-12 14:53:22,564 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53909, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328, duration: 5273000
2015-02-12 14:53:22,565 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:22,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:53:22,566 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53908, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328, duration: 5880000
2015-02-12 14:53:22,566 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,566 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:53:22,567 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53907, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328, duration: 6943000
2015-02-12 14:53:22,567 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,567 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:22,572 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary_tmp is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:22,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:53:22,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:22,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:53:22,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:22,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:53:22,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,597 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:53:22,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329 src: /127.0.0.1:53911 dest: /127.0.0.1:50546
2015-02-12 14:53:22,601 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329 src: /127.0.0.1:53912 dest: /127.0.0.1:50539
2015-02-12 14:53:22,602 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329 src: /127.0.0.1:53913 dest: /127.0.0.1:50543
2015-02-12 14:53:22,608 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53913, dest: /127.0.0.1:50543, bytes: 69220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329, duration: 3576000
2015-02-12 14:53:22,608 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:22,608 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:53:22,609 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53912, dest: /127.0.0.1:50539, bytes: 69220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329, duration: 4498000
2015-02-12 14:53:22,609 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,609 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:53:22,610 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53911, dest: /127.0.0.1:50546, bytes: 69220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329, duration: 5389000
2015-02-12 14:53:22,610 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,610 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:53:22,612 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:22,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:53:22,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:22,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:53:22,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:22,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029/job_1423780884992_0029_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:53:22,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:22,635 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:53:22,638 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330 src: /127.0.0.1:53915 dest: /127.0.0.1:50543
2015-02-12 14:53:22,639 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330 src: /127.0.0.1:53916 dest: /127.0.0.1:50546
2015-02-12 14:53:22,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330 src: /127.0.0.1:53917 dest: /127.0.0.1:50549
2015-02-12 14:53:22,644 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53917, dest: /127.0.0.1:50549, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330, duration: 1773000
2015-02-12 14:53:22,644 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:22,644 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:22,644 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53916, dest: /127.0.0.1:50546, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330, duration: 2474000
2015-02-12 14:53:22,645 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,645 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:22,645 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53915, dest: /127.0.0.1:50543, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1964815287_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330, duration: 3254000
2015-02-12 14:53:22,645 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:22,646 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:22,648 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1964815287_1
2015-02-12 14:53:22,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:22,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:22,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:22,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:22,671 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0029_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:53:22,671 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:53:22,672 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0029 with final state: FINISHING
2015-02-12 14:53:22,672 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from RUNNING to FINAL_SAVING
2015-02-12 14:53:22,672 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0029
2015-02-12 14:53:22,673 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:53:22,673 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from FINAL_SAVING to FINISHING
2015-02-12 14:53:23,459 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:23,459 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:53:23,459 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000008
2015-02-12 14:53:23,460 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:53:23,460 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000008 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:53:23,500 INFO hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 14:53:23,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:53:23,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:53:23,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,515 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0022,submitTime=1423781412733,launchTime=1423781417943,firstMapTaskLaunchTime=1423781420089,firstReduceTaskLaunchTime=1423781427000,finishTime=1423781430570,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=2,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=9,reduceSlotSeconds=3,jobName=[087161660051449A90B68F05F9FBBD9A/75E1719120A54FFB949905BFC5B9A0BD] lower*upper/(3/3) ...dpipesplatform/afterevery
2015-02-12 14:53:23,515 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary]
2015-02-12 14:53:23,516 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0024,submitTime=1423781458114,launchTime=1423781462500,firstMapTaskLaunchTime=1423781464690,firstReduceTaskLaunchTime=1423781477605,finishTime=1423781480748,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=54,reduceSlotSeconds=3,jobName=[B2198E926A9642258DBA549CC673ABC6/00B2E0391D374C3393F68D92FC24225E] lower*upper/(1/1) ...latform/cogroupouterinner
2015-02-12 14:53:23,516 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary]
2015-02-12 14:53:23,518 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0023,submitTime=1423781432070,launchTime=1423781436384,firstMapTaskLaunchTime=1423781438563,firstReduceTaskLaunchTime=1423781453497,finishTime=1423781456659,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=74,reduceSlotSeconds=3,jobName=[D54F92D3C1B64EA6AE805D32E84412C6/C5F38FB507F2477DB7622E2291A629DC] offsetLower*lower/(1/1) ...atform/samefiledifffields
2015-02-12 14:53:23,518 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary]
2015-02-12 14:53:23,518 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742075_1251 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:53:23,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,519 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742097_1273 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:53:23,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742086_1262 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:53:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,522 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist
2015-02-12 14:53:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,524 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist
2015-02-12 14:53:23,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0022-1423781412733-soberoi-%5B087161660051449A90B68F05F9FBBD9A%2F75E1719120A54FFB-1423781430570-2-1-SUCCEEDED-root.soberoi-1423781417943.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,525 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0022_conf.xml
2015-02-12 14:53:23,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0024-1423781458114-soberoi-%5BB2198E926A9642258DBA549CC673ABC6%2F00B2E0391D374C33-1423781480748-5-1-SUCCEEDED-root.soberoi-1423781462500.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,527 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist
2015-02-12 14:53:23,527 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0024_conf.xml
2015-02-12 14:53:23,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0022_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0022_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0023-1423781432070-soberoi-%5BD54F92D3C1B64EA6AE805D32E84412C6%2FC5F38FB507F2477D-1423781456659-6-1-SUCCEEDED-root.soberoi-1423781436384.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0024_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0024_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,529 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0023_conf.xml
2015-02-12 14:53:23,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0023_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0023_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,534 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0025,submitTime=1423781482242,launchTime=1423781486557,firstMapTaskLaunchTime=1423781488735,firstReduceTaskLaunchTime=1423781501665,finishTime=1423781504920,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=51,reduceSlotSeconds=3,jobName=[C50DF3680A2240F88EBE723BEF649330/CCCF3B41A5CC419BBB1C12AE7D09702B] lower*upper/(1/1) ...oupouterinner-resultgroup
2015-02-12 14:53:23,534 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary]
2015-02-12 14:53:23,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,536 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0026,submitTime=1423781506416,launchTime=1423781510537,firstMapTaskLaunchTime=1423781512692,firstReduceTaskLaunchTime=1423781525639,finishTime=1423781528956,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=52,reduceSlotSeconds=3,jobName=[3419F690C01D465B8C4CB4380C42CECF/281B7A1609B542D1A0925D692D04FF6D] lower*upper/(1/1) ...orm/cogroupinnerouternull
2015-02-12 14:53:23,536 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary]
2015-02-12 14:53:23,537 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742108_1284 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:53:23,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,538 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0027,submitTime=1423781530446,launchTime=1423781534624,firstMapTaskLaunchTime=1423781536862,firstReduceTaskLaunchTime=1423781550739,finishTime=1423781553958,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=57,reduceSlotSeconds=3,jobName=[D4F28AE7EF8A49DEAAFC926E8C8A9571/4135E92F1C804F369F432D1B0EFAE62A] lower*upper/(1/1) ...nnerouternull-resultgroup
2015-02-12 14:53:23,539 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary]
2015-02-12 14:53:23,539 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742119_1295 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:53:23,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,542 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742130_1306 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:53:23,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,542 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist
2015-02-12 14:53:23,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,543 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist
2015-02-12 14:53:23,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0025-1423781482242-soberoi-%5BC50DF3680A2240F88EBE723BEF649330%2FCCCF3B41A5CC419B-1423781504920-5-1-SUCCEEDED-root.soberoi-1423781486557.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,548 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0025_conf.xml
2015-02-12 14:53:23,548 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist
2015-02-12 14:53:23,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0026-1423781506416-soberoi-%5B3419F690C01D465B8C4CB4380C42CECF%2F281B7A1609B542D1-1423781528956-5-1-SUCCEEDED-root.soberoi-1423781510537.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,549 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0026_conf.xml
2015-02-12 14:53:23,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0025_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0025_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0027-1423781530446-soberoi-%5BD4F28AE7EF8A49DEAAFC926E8C8A9571%2F4135E92F1C804F36-1423781553958-5-1-SUCCEEDED-root.soberoi-1423781534624.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,550 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0027_conf.xml
2015-02-12 14:53:23,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0026_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0026_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0027_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0027_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,554 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0029,submitTime=1423781579314,launchTime=1423781583936,firstMapTaskLaunchTime=1423781586121,firstReduceTaskLaunchTime=1423781599042,finishTime=1423781602521,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=52,reduceSlotSeconds=3,jobName=[4551335934A24D48804239416AD77B0B/9F0AEE9C65C6440BBC048604628E7454] lower*upper/(1/1) ...roupouternull-resultgroup
2015-02-12 14:53:23,555 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0028,submitTime=1423781555510,launchTime=1423781559491,firstMapTaskLaunchTime=1423781561763,firstReduceTaskLaunchTime=1423781574621,finishTime=1423781577853,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=3,jobName=[E15B188C0EB4483FADA8AEC7B9307695/79666561EECD488EBA095188FDCE15A2] lower*upper/(1/1) ...platform/cogroupouternull
2015-02-12 14:53:23,555 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary]
2015-02-12 14:53:23,555 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary]
2015-02-12 14:53:23,557 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742141_1317 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:53:23,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,558 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742152_1328 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:53:23,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029.summary dst=null perm=null proto=rpc
2015-02-12 14:53:23,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,560 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist
2015-02-12 14:53:23,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,561 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist
2015-02-12 14:53:23,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0028-1423781555510-soberoi-%5BE15B188C0EB4483FADA8AEC7B9307695%2F79666561EECD488E-1423781577853-5-1-SUCCEEDED-root.soberoi-1423781559491.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,563 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0028_conf.xml
2015-02-12 14:53:23,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0029-1423781579314-soberoi-%5B4551335934A24D48804239416AD77B0B%2F9F0AEE9C65C6440B-1423781602521-5-1-SUCCEEDED-root.soberoi-1423781583936.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,564 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0029_conf.xml
2015-02-12 14:53:23,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0028_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0028_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0029_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0029_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:23,678 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0029 unregistered successfully.
2015-02-12 14:53:23,683 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742144_1320 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:53:23,683 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742145_1321 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:53:23,684 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742146_1322 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:53:23,684 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742147_1323 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:53:23,684 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742149_1325 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:53:23,684 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742150_1326 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:53:23,684 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742148_1324 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:53:23,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0029 dst=null perm=null proto=rpc
2015-02-12 14:53:23,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,730 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary
2015-02-12 14:53:23,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:53:23,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,750 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:23,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,787 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:23,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,797 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull
2015-02-12 14:53:23,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:53:23,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:53:23,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:53:23,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull dst=null perm=null proto=rpc
2015-02-12 14:53:23,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,812 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup
2015-02-12 14:53:23,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:53:23,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouternull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:23,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:23,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:23,847 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:53:23,847 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:53:23,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2015-02-12 14:53:23,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:23,871 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] starting
2015-02-12 14:53:23,871 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:53:23,872 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:53:23,872 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes"]
2015-02-12 14:53:23,872 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] parallel execution is enabled: true
2015-02-12 14:53:23,872 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] starting jobs: 1
2015-02-12 14:53:23,872 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] allocating threads: 1
2015-02-12 14:53:23,873 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] starting step: (1/1) ...ipesplatform/renamedpipes
2015-02-12 14:53:23,904 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:53:23,926 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:53:23,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:23,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:23,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:23,938 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 30
2015-02-12 14:53:23,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030 dst=null perm=null proto=rpc
2015-02-12 14:53:23,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:53:23,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:53:23,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:23,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:23,953 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:53:23,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 src: /127.0.0.1:53926 dest: /127.0.0.1:50549
2015-02-12 14:53:23,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 src: /127.0.0.1:53927 dest: /127.0.0.1:50543
2015-02-12 14:53:23,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 src: /127.0.0.1:53928 dest: /127.0.0.1:50546
2015-02-12 14:53:23,986 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53928, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331, duration: 2858000
2015-02-12 14:53:23,986 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:23,987 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:53:23,987 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53927, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331, duration: 3369000
2015-02-12 14:53:23,987 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:23,987 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:53:23,988 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53926, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331, duration: 4736000
2015-02-12 14:53:23,988 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:23,989 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:53:23,990 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:23,991 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar
2015-02-12 14:53:23,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:23,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:23,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:23,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:23,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:53:24,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:53:24,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:53:24,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:53:24,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:53:24,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,011 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:24,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,015 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:24,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,021 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:24,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,024 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:24,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:24,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:24,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:24,030 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split
2015-02-12 14:53:24,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:24,032 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:53:24,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332 src: /127.0.0.1:53929 dest: /127.0.0.1:50546
2015-02-12 14:53:24,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332 src: /127.0.0.1:53930 dest: /127.0.0.1:50543
2015-02-12 14:53:24,038 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332 src: /127.0.0.1:53931 dest: /127.0.0.1:50549
2015-02-12 14:53:24,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332 src: /127.0.0.1:53932 dest: /127.0.0.1:50539
2015-02-12 14:53:24,044 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53932, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, duration: 3402000
2015-02-12 14:53:24,048 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:24,049 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,049 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53931, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, duration: 8167000
2015-02-12 14:53:24,049 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,050 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,050 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53930, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, duration: 9330000
2015-02-12 14:53:24,050 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,051 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,051 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53929, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, duration: 10313000
2015-02-12 14:53:24,051 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,052 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,054 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:24,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:24,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:24,062 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:53:24,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333 src: /127.0.0.1:53933 dest: /127.0.0.1:50543
2015-02-12 14:53:24,069 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333 src: /127.0.0.1:53934 dest: /127.0.0.1:50549
2015-02-12 14:53:24,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333 src: /127.0.0.1:53935 dest: /127.0.0.1:50539
2015-02-12 14:53:24,074 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53935, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333, duration: 1823000
2015-02-12 14:53:24,074 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:24,074 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:53:24,075 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53934, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333, duration: 2402000
2015-02-12 14:53:24,075 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,076 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,076 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53933, dest: /127.0.0.1:50543, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333, duration: 3303000
2015-02-12 14:53:24,076 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,076 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,081 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:24,081 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:53:24,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:24,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:24,091 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:53:24,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334 src: /127.0.0.1:53936 dest: /127.0.0.1:50546
2015-02-12 14:53:24,094 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334 src: /127.0.0.1:53937 dest: /127.0.0.1:50549
2015-02-12 14:53:24,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334 src: /127.0.0.1:53938 dest: /127.0.0.1:50543
2015-02-12 14:53:24,098 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53938, dest: /127.0.0.1:50543, bytes: 97425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334, duration: 1590000
2015-02-12 14:53:24,098 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:24,099 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:24,099 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53937, dest: /127.0.0.1:50549, bytes: 97425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334, duration: 2003000
2015-02-12 14:53:24,099 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:24,100 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53936, dest: /127.0.0.1:50546, bytes: 97425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334, duration: 2875000
2015-02-12 14:53:24,100 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:24,102 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:24,106 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:24,107 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0030
2015-02-12 14:53:24,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030 dst=null perm=null proto=rpc
2015-02-12 14:53:24,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:24,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:24,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:24,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:24,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:24,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:24,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,135 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 30 submitted by user soberoi
2015-02-12 14:53:24,135 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0030
2015-02-12 14:53:24,135 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from NEW to NEW_SAVING
2015-02-12 14:53:24,135 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0030
2015-02-12 14:53:24,135 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0030
2015-02-12 14:53:24,135 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:53:24,136 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0030 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:53:24,136 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from SUBMITTED to ACCEPTED
2015-02-12 14:53:24,136 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0030_000001
2015-02-12 14:53:24,136 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from NEW to SUBMITTED
2015-02-12 14:53:24,137 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0030_000001 to scheduler from user: soberoi
2015-02-12 14:53:24,137 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:53:24,137 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0030
2015-02-12 14:53:24,139 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0030/
2015-02-12 14:53:24,140 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] submitted hadoop job: job_1423780884992_0030
2015-02-12 14:53:24,140 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0030/
2015-02-12 14:53:24,461 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:24,461 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:24,462 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000001
2015-02-12 14:53:24,462 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:53:24,462 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0030_01_000001
2015-02-12 14:53:24,462 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:24,462 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0030_000001
2015-02-12 14:53:24,463 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0030 AttemptId: appattempt_1423780884992_0030_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0030_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:53:24,463 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:53:24,463 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:53:24,463 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0030_000001
2015-02-12 14:53:24,464 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0030_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0030_000001
2015-02-12 14:53:24,464 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0030_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:53:24,464 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0030_000001
2015-02-12 14:53:24,464 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0030_000001
2015-02-12 14:53:24,466 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:24,468 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000001 by user soberoi
2015-02-12 14:53:24,468 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0030
2015-02-12 14:53:24,469 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000001
2015-02-12 14:53:24,469 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from NEW to INITING
2015-02-12 14:53:24,469 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000001 to application application_1423780884992_0030
2015-02-12 14:53:24,469 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from INITING to RUNNING
2015-02-12 14:53:24,469 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0030_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0030_000001
2015-02-12 14:53:24,469 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:53:24,469 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:53:24,469 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:24,470 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:24,470 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:53:24,470 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:53:24,470 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:24,470 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0030_01_000001
2015-02-12 14:53:24,480 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0030_01_000001.tokens. Credentials list:
2015-02-12 14:53:24,596 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:24,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0030_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000001.tokens
2015-02-12 14:53:24,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:24,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:24,829 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:24,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:24,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:24,893 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0030/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:24,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:24,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:24,952 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0030/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:24,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:24,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:25,026 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:25,026 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:25,063 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:25,063 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:25,175 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000001/default_container_executor.sh]
2015-02-12 14:53:25,240 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742155_1331 to datanode(s) 127.0.0.1:50539
2015-02-12 14:53:25,241 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742144_1320, blk_1073742145_1321, blk_1073742097_1273, blk_1073742146_1322, blk_1073742147_1323, blk_1073742149_1325, blk_1073742119_1295, blk_1073742152_1328, blk_1073742075_1251, blk_1073742108_1284, blk_1073742141_1317]
2015-02-12 14:53:25,241 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742144_1320, blk_1073742145_1321, blk_1073742146_1322, blk_1073742130_1306, blk_1073742147_1323, blk_1073742148_1324, blk_1073742149_1325, blk_1073742150_1326, blk_1073742086_1262, blk_1073742119_1295, blk_1073742152_1328, blk_1073742141_1317]
2015-02-12 14:53:25,461 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:25,462 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144 for deletion
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742097 for deletion
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145 for deletion
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742146 for deletion
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742147 for deletion
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144
2015-02-12 14:53:26,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742097
2015-02-12 14:53:26,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145
2015-02-12 14:53:26,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742146
2015-02-12 14:53:26,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742149 for deletion
2015-02-12 14:53:26,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742119 for deletion
2015-02-12 14:53:26,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742152_1328 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742152 for deletion
2015-02-12 14:53:26,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742075_1251 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742075 for deletion
2015-02-12 14:53:26,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742108 for deletion
2015-02-12 14:53:26,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742141 for deletion
2015-02-12 14:53:26,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742147
2015-02-12 14:53:26,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742119
2015-02-12 14:53:26,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742149
2015-02-12 14:53:26,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742141
2015-02-12 14:53:26,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742152_1328 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742152
2015-02-12 14:53:26,083 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742075_1251 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742075
2015-02-12 14:53:26,083 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742108
2015-02-12 14:53:26,400 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 to 127.0.0.1:50539
2015-02-12 14:53:26,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 src: /127.0.0.1:53942 dest: /127.0.0.1:50539
2015-02-12 14:53:26,402 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:53:26,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331 src: /127.0.0.1:53942 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:53:26,404 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742155_1331 size 254067
2015-02-12 14:53:26,463 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:26,663 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144 for deletion
2015-02-12 14:53:26,663 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145 for deletion
2015-02-12 14:53:26,663 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742130 for deletion
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742146 for deletion
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742130
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742147 for deletion
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742146
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742148 for deletion
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742149 for deletion
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742086 for deletion
2015-02-12 14:53:26,664 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742147
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742150 for deletion
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742119 for deletion
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742149
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742148
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742086
2015-02-12 14:53:26,665 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742152_1328 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742152 for deletion
2015-02-12 14:53:26,666 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742150
2015-02-12 14:53:26,666 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742141 for deletion
2015-02-12 14:53:26,666 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742119
2015-02-12 14:53:26,666 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742152_1328 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742152
2015-02-12 14:53:26,666 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742141
2015-02-12 14:53:27,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:27,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:53:27,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:53:27,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:53:27,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030 dst=null perm=null proto=rpc
2015-02-12 14:53:27,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:53:27,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:53:27,463 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:27,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:27,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:27,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329
2015-02-12 14:53:27,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742150_1326
2015-02-12 14:53:27,816 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742152_1328
2015-02-12 14:53:27,816 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330
2015-02-12 14:53:27,817 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327
2015-02-12 14:53:28,033 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327
2015-02-12 14:53:28,034 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330
2015-02-12 14:53:28,245 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742144_1320, blk_1073742145_1321, blk_1073742146_1322, blk_1073742148_1324, blk_1073742149_1325, blk_1073742086_1262, blk_1073742150_1326, blk_1073742119_1295, blk_1073742097_1273, blk_1073742130_1306, blk_1073742075_1251, blk_1073742108_1284, blk_1073742141_1317]
2015-02-12 14:53:28,245 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742144_1320, blk_1073742145_1321, blk_1073742097_1273, blk_1073742130_1306, blk_1073742147_1323, blk_1073742148_1324, blk_1073742150_1326, blk_1073742086_1262, blk_1073742152_1328, blk_1073742075_1251, blk_1073742108_1284]
2015-02-12 14:53:28,467 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:28,731 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0029_01_000001 succeeded
2015-02-12 14:53:28,731 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:53:28,731 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0029_01_000001
2015-02-12 14:53:28,751 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000001
2015-02-12 14:53:28,751 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000001
2015-02-12 14:53:28,751 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000001
2015-02-12 14:53:28,751 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000001
2015-02-12 14:53:28,752 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0029_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:53:28,752 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029/container_1423780884992_0029_01_000001
2015-02-12 14:53:28,752 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0029_01_000001 from application application_1423780884992_0029
2015-02-12 14:53:28,752 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:28,752 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0029
2015-02-12 14:53:28,784 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:28,788 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0030_000001
2015-02-12 14:53:28,788 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0030 APPATTEMPTID=appattempt_1423780884992_0030_000001
2015-02-12 14:53:28,788 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:53:28,788 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from ACCEPTED to RUNNING
2015-02-12 14:53:28,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:28,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:53:29,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:29,043 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144 for deletion
2015-02-12 14:53:29,043 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145 for deletion
2015-02-12 14:53:29,043 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742146 for deletion
2015-02-12 14:53:29,043 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742148 for deletion
2015-02-12 14:53:29,043 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742149 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742086 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742150 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742119 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742097 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742130 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742075_1251 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742075 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742108 for deletion
2015-02-12 14:53:29,044 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742141 for deletion
2015-02-12 14:53:29,045 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144
2015-02-12 14:53:29,046 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742146
2015-02-12 14:53:29,046 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742149
2015-02-12 14:53:29,046 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145
2015-02-12 14:53:29,046 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742119
2015-02-12 14:53:29,047 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742148
2015-02-12 14:53:29,047 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742086
2015-02-12 14:53:29,048 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742150
2015-02-12 14:53:29,048 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742097
2015-02-12 14:53:29,048 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742075_1251 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742075
2015-02-12 14:53:29,048 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742130
2015-02-12 14:53:29,049 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742108
2015-02-12 14:53:29,049 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742141
2015-02-12 14:53:29,310 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:53:29,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335 src: /127.0.0.1:53950 dest: /127.0.0.1:50539
2015-02-12 14:53:29,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335 src: /127.0.0.1:53951 dest: /127.0.0.1:50543
2015-02-12 14:53:29,368 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335 src: /127.0.0.1:53952 dest: /127.0.0.1:50546
2015-02-12 14:53:29,399 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742097 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742130 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742147 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742148 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742086 for deletion
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742144_1320 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742144
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742130
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742097
2015-02-12 14:53:29,400 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742150 for deletion
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742152_1328 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742152 for deletion
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742145
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742147
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742148
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742086
2015-02-12 14:53:29,401 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742075_1251 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742075 for deletion
2015-02-12 14:53:29,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742150
2015-02-12 14:53:29,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742108 for deletion
2015-02-12 14:53:29,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742075_1251 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir0/blk_1073742075
2015-02-12 14:53:29,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742152_1328 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742152
2015-02-12 14:53:29,404 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742108
2015-02-12 14:53:29,424 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53952, dest: /127.0.0.1:50546, bytes: 114140, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335, duration: 54258000
2015-02-12 14:53:29,424 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:29,424 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53951, dest: /127.0.0.1:50543, bytes: 114140, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335, duration: 54887000
2015-02-12 14:53:29,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:53:29,424 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:29,425 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:29,425 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53950, dest: /127.0.0.1:50539, bytes: 114140, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335, duration: 55692000
2015-02-12 14:53:29,425 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:29,425 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:29,434 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:29,469 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0029_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:29,469 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0029_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:53:29,469 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000001
2015-02-12 14:53:29,470 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0029_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:53:29,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:29,470 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0029_000001
2015-02-12 14:53:29,470 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0029_000001
2015-02-12 14:53:29,470 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0029_000001 State change from FINISHING to FINISHED
2015-02-12 14:53:29,470 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0029 State change from FINISHING to FINISHED
2015-02-12 14:53:29,471 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0029
2015-02-12 14:53:29,471 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0029,name=[4551335934A24D48804239416AD77B0B/9F0AEE9C65C6440BBC048604628E7454] lower*upper/(1/1) ...roupouternull-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0029/jobhistory/job/job_1423780884992_0029,appMasterHost=10.1.1.67,startTime=1423781579314,finishTime=1423781602672,finalStatus=SUCCEEDED
2015-02-12 14:53:29,470 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0029_000001 released container container_1423780884992_0029_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:53:29,471 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:29,471 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0029_000001
2015-02-12 14:53:29,471 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0029_000001 is done. finalState=FINISHED
2015-02-12 14:53:29,472 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0029 requests cleared
2015-02-12 14:53:29,473 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:53:29,474 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0029_000001 (auth:SIMPLE)
2015-02-12 14:53:29,476 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0029_01_000001
2015-02-12 14:53:29,476 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0029 CONTAINERID=container_1423780884992_0029_01_000001
2015-02-12 14:53:29,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336 src: /127.0.0.1:53954 dest: /127.0.0.1:50549
2015-02-12 14:53:29,477 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0029_01_000001]
2015-02-12 14:53:29,477 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:29,478 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:29,478 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:29,478 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,478 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,478 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,478 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0029
2015-02-12 14:53:29,479 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:29,479 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0029, with delay of 10800 seconds
2015-02-12 14:53:29,478 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336 src: /127.0.0.1:53955 dest: /127.0.0.1:50546
2015-02-12 14:53:29,479 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,484 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336 src: /127.0.0.1:53956 dest: /127.0.0.1:50543
2015-02-12 14:53:29,496 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53956, dest: /127.0.0.1:50543, bytes: 388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336, duration: 8620000
2015-02-12 14:53:29,496 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:29,497 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:29,498 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53955, dest: /127.0.0.1:50546, bytes: 388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336, duration: 9876000
2015-02-12 14:53:29,498 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:29,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:29,499 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:53954, dest: /127.0.0.1:50549, bytes: 388, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336, duration: 11309000
2015-02-12 14:53:29,499 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:29,500 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:29,502 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030.summary is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:29,891 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:29,891 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:29,891 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000002
2015-02-12 14:53:29,891 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:53:29,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,892 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0029
2015-02-12 14:53:29,892 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:29,892 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0029, with delay of 10800 seconds
2015-02-12 14:53:29,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,996 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:29,997 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:29,997 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000003
2015-02-12 14:53:29,997 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:53:29,997 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,998 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0029
2015-02-12 14:53:29,998 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:29,998 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,998 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0029, with delay of 10800 seconds
2015-02-12 14:53:29,999 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:29,999 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:30,023 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:30,023 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:30,023 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000004
2015-02-12 14:53:30,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:30,024 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:53:30,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:30,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:30,025 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0029
2015-02-12 14:53:30,026 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:30,026 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0029, with delay of 10800 seconds
2015-02-12 14:53:30,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0029
2015-02-12 14:53:30,483 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:30,483 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:30,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000005
2015-02-12 14:53:30,483 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:53:30,859 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0030_01_000002
2015-02-12 14:53:30,860 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:30,860 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0030_01_000003
2015-02-12 14:53:30,860 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:30,860 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0030_01_000004
2015-02-12 14:53:30,861 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:30,861 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0030_01_000005
2015-02-12 14:53:30,861 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:30,895 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:30,895 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000006
2015-02-12 14:53:30,895 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:53:30,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:30,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:30,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:30,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,000 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:31,001 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000007
2015-02-12 14:53:31,001 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:53:31,021 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:31,021 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:31,022 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:31,022 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:31,024 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000005 by user soberoi
2015-02-12 14:53:31,024 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000005
2015-02-12 14:53:31,024 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000005 to application application_1423780884992_0030
2015-02-12 14:53:31,024 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000003 by user soberoi
2015-02-12 14:53:31,025 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:53:31,025 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,025 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,025 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:31,025 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:31,025 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:31,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0030
2015-02-12 14:53:31,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000003
2015-02-12 14:53:31,026 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from NEW to INITING
2015-02-12 14:53:31,026 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000003 to application application_1423780884992_0030
2015-02-12 14:53:31,027 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from INITING to RUNNING
2015-02-12 14:53:31,027 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:53:31,027 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,027 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,027 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:31,027 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:31,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:31,028 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:31,028 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0030_01_000003
2015-02-12 14:53:31,035 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000002 by user soberoi
2015-02-12 14:53:31,035 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0030
2015-02-12 14:53:31,036 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000002
2015-02-12 14:53:31,036 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from NEW to INITING
2015-02-12 14:53:31,036 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000002 to application application_1423780884992_0030
2015-02-12 14:53:31,036 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from INITING to RUNNING
2015-02-12 14:53:31,036 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:53:31,036 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,037 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,037 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:31,037 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:31,038 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:31,038 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:31,038 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0030_01_000002
2015-02-12 14:53:31,053 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0030_01_000003.tokens. Credentials list:
2015-02-12 14:53:31,059 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000004 by user soberoi
2015-02-12 14:53:31,059 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0030
2015-02-12 14:53:31,060 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000004
2015-02-12 14:53:31,060 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from NEW to INITING
2015-02-12 14:53:31,060 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000004 to application application_1423780884992_0030
2015-02-12 14:53:31,060 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from INITING to RUNNING
2015-02-12 14:53:31,061 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:53:31,061 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,061 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,061 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:31,061 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:31,061 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:31,061 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:31,061 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0030_01_000004
2015-02-12 14:53:31,065 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0030_01_000002.tokens. Credentials list:
2015-02-12 14:53:31,086 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0030_01_000004.tokens. Credentials list:
2015-02-12 14:53:31,096 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:31,097 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:31,307 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:31,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:31,334 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:31,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000005/default_container_executor.sh]
2015-02-12 14:53:31,487 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:31,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0030_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000002.tokens
2015-02-12 14:53:31,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:31,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0030_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000003.tokens
2015-02-12 14:53:31,520 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:31,549 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0030_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000004.tokens
2015-02-12 14:53:31,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:31,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:31,844 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:31,854 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:31,872 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:31,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:31,892 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:31,893 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:31,895 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:31,896 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:31,896 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000008
2015-02-12 14:53:31,896 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:53:31,897 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000007 by user soberoi
2015-02-12 14:53:31,897 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000006 by user soberoi
2015-02-12 14:53:31,897 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000007
2015-02-12 14:53:31,897 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000006 to application application_1423780884992_0030
2015-02-12 14:53:31,897 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:53:31,897 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,898 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,898 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:31,898 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:31,898 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0030_01_000006
2015-02-12 14:53:31,897 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000006
2015-02-12 14:53:31,897 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000007 to application application_1423780884992_0030
2015-02-12 14:53:31,899 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:53:31,899 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,899 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:31,899 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:31,900 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:31,900 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0030_01_000007
2015-02-12 14:53:31,931 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0030_01_000006.tokens. Credentials list:
2015-02-12 14:53:31,932 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0030_01_000007.tokens. Credentials list:
2015-02-12 14:53:31,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:31,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:31,939 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0030/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:31,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:31,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:31,986 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332
2015-02-12 14:53:31,987 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331
2015-02-12 14:53:31,988 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742151_1327
2015-02-12 14:53:31,988 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333
2015-02-12 14:53:31,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:31,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:32,001 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:32,001 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:32,001 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:32,002 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000009
2015-02-12 14:53:32,002 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:53:32,024 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:32,024 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:32,024 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:32,031 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:32,044 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:32,044 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:32,045 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:32,096 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:32,096 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:32,110 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:32,110 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:32,113 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0030/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:32,113 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:32,125 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:32,125 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:32,125 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:32,126 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:32,190 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329
2015-02-12 14:53:32,193 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333
2015-02-12 14:53:32,195 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331
2015-02-12 14:53:32,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742153_1329
2015-02-12 14:53:32,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332
2015-02-12 14:53:32,231 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:32,232 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:32,401 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742154_1330
2015-02-12 14:53:32,403 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334
2015-02-12 14:53:32,520 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000006/default_container_executor.sh]
2015-02-12 14:53:32,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000003/default_container_executor.sh]
2015-02-12 14:53:32,544 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000002/default_container_executor.sh]
2015-02-12 14:53:32,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000007/default_container_executor.sh]
2015-02-12 14:53:32,691 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000004/default_container_executor.sh]
2015-02-12 14:53:32,822 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331
2015-02-12 14:53:32,823 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332
2015-02-12 14:53:32,879 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:53:32,880 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:32,880 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:32,900 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:33,022 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334
2015-02-12 14:53:33,040 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742156_1332
2015-02-12 14:53:33,041 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742158_1334
2015-02-12 14:53:33,041 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742157_1333
2015-02-12 14:53:33,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:33,080 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:33,216 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423780884992_0030_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000007.tokens
2015-02-12 14:53:33,216 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:33,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0030_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000006.tokens
2015-02-12 14:53:33,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:33,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742155_1331
2015-02-12 14:53:33,886 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:53:33,886 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:53:33,886 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000008
2015-02-12 14:53:33,887 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:53:33,887 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000008 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:53:33,887 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:53:33,887 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:53:33,887 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000009
2015-02-12 14:53:33,887 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:53:33,887 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000009 on node: host: 10.1.1.67:50579 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:53:33,901 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0030_01_000008
2015-02-12 14:53:34,003 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0030_01_000009
2015-02-12 14:53:37,195 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335
2015-02-12 14:53:37,410 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335
2015-02-12 14:53:37,410 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336
2015-02-12 14:53:38,026 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336
2015-02-12 14:53:38,027 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742159_1335
2015-02-12 14:53:38,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742160_1336
2015-02-12 14:53:39,600 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 14:53:39,600 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:53:44,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:45,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:45,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:45,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:45,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:45,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:45,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:45,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:45,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:45,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:45,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:45,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:46,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:53:46,178 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:46,179 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000005
2015-02-12 14:53:46,180 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000005
2015-02-12 14:53:46,180 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:53:46,180 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000005
2015-02-12 14:53:46,206 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:53:46,207 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000005 is : 143
2015-02-12 14:53:46,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337 src: /127.0.0.1:54007 dest: /127.0.0.1:50546
2015-02-12 14:53:46,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337 src: /127.0.0.1:54008 dest: /127.0.0.1:50549
2015-02-12 14:53:46,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337 src: /127.0.0.1:54009 dest: /127.0.0.1:50543
2015-02-12 14:53:46,223 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist for DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:46,223 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:46,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000005
2015-02-12 14:53:46,225 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000005
2015-02-12 14:53:46,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000005
2015-02-12 14:53:46,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000005
2015-02-12 14:53:46,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000005
2015-02-12 14:53:46,226 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:46,229 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000005 from application application_1423780884992_0030
2015-02-12 14:53:46,229 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:46,229 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:46,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:53:46,437 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:46,438 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000006
2015-02-12 14:53:46,439 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000006
2015-02-12 14:53:46,439 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:53:46,439 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000006
2015-02-12 14:53:46,459 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000006 is : 143
2015-02-12 14:53:46,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:53:46,472 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:46,473 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000006
2015-02-12 14:53:46,473 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000006
2015-02-12 14:53:46,473 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000006
2015-02-12 14:53:46,473 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000006
2015-02-12 14:53:46,473 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000006
2015-02-12 14:53:46,473 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:46,474 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000006 from application application_1423780884992_0030
2015-02-12 14:53:46,474 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:46,474 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:46,493 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:46,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:53:46,498 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000007
2015-02-12 14:53:46,498 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000007
2015-02-12 14:53:46,499 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:53:46,499 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000007
2015-02-12 14:53:46,524 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000007 is : 143
2015-02-12 14:53:46,533 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:46,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000007
2015-02-12 14:53:46,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000007
2015-02-12 14:53:46,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000007
2015-02-12 14:53:46,535 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000007
2015-02-12 14:53:46,536 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:46,536 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000007 from application application_1423780884992_0030
2015-02-12 14:53:46,536 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:46,536 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:46,536 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000007
2015-02-12 14:53:46,557 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:46,559 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000003
2015-02-12 14:53:46,559 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000003
2015-02-12 14:53:46,559 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:53:46,560 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000003
2015-02-12 14:53:46,560 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:46,560 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:53:46,560 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000007
2015-02-12 14:53:46,560 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:53:46,561 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000007 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:53:46,579 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000003 is : 143
2015-02-12 14:53:46,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:53:46,591 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:46,592 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000003
2015-02-12 14:53:46,592 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000003
2015-02-12 14:53:46,593 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000003
2015-02-12 14:53:46,593 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000003
2015-02-12 14:53:46,594 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000003
2015-02-12 14:53:46,594 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:46,594 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000003 from application application_1423780884992_0030
2015-02-12 14:53:46,594 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:46,594 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:46,614 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:46,616 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000002
2015-02-12 14:53:46,616 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000002
2015-02-12 14:53:46,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:53:46,617 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:53:46,617 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000002
2015-02-12 14:53:46,618 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:46,621 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:53:46,621 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000006
2015-02-12 14:53:46,622 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:53:46,622 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000006 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:53:46,642 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000002 is : 143
2015-02-12 14:53:46,654 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:46,654 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000002
2015-02-12 14:53:46,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000002
2015-02-12 14:53:46,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000002
2015-02-12 14:53:46,655 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000002
2015-02-12 14:53:46,656 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:46,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000002
2015-02-12 14:53:46,656 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000002 from application application_1423780884992_0030
2015-02-12 14:53:46,656 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:46,656 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:46,685 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:46,687 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000004
2015-02-12 14:53:46,687 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000004
2015-02-12 14:53:46,688 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:53:46,688 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000004
2015-02-12 14:53:46,708 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000004 is : 143
2015-02-12 14:53:46,721 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:46,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000004
2015-02-12 14:53:46,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000004
2015-02-12 14:53:46,723 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000004
2015-02-12 14:53:46,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000004
2015-02-12 14:53:46,725 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000004
2015-02-12 14:53:46,726 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:46,727 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000004 from application application_1423780884992_0030
2015-02-12 14:53:46,727 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:46,727 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:47,183 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:47,183 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:53:47,183 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000005
2015-02-12 14:53:47,184 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:53:47,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000005 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:53:47,561 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:47,561 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:53:47,561 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000003
2015-02-12 14:53:47,561 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:47,561 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:47,562 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:47,621 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:47,621 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:53:47,622 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000002
2015-02-12 14:53:47,622 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:47,622 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000002 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:47,622 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:47,694 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:47,695 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:53:47,695 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000004
2015-02-12 14:53:47,695 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:53:47,696 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:53:48,184 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:48,185 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:48,185 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000010
2015-02-12 14:53:48,185 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0030_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:53:48,566 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000007]
2015-02-12 14:53:48,566 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:48,567 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:48,626 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000006]
2015-02-12 14:53:48,626 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:48,626 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:48,697 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:48,952 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:48,962 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:48,964 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0030_01_000010 by user soberoi
2015-02-12 14:53:48,964 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0030_01_000010 to application application_1423780884992_0030
2015-02-12 14:53:48,964 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000010
2015-02-12 14:53:48,964 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 14:53:48,965 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0030
2015-02-12 14:53:48,965 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0030
2015-02-12 14:53:48,965 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:53:48,965 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0030
2015-02-12 14:53:48,965 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:48,996 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:48,997 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:49,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000010/default_container_executor.sh]
2015-02-12 14:53:49,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000005]
2015-02-12 14:53:49,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:49,186 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:49,570 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000003]
2015-02-12 14:53:49,570 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:49,629 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000002]
2015-02-12 14:53:49,629 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:49,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000004]
2015-02-12 14:53:49,699 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:49,955 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:53:51,756 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:51,758 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:51,762 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:51,764 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:51,772 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:53:52,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,064 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:53:52,172 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338 src: /127.0.0.1:54038 dest: /127.0.0.1:50546
2015-02-12 14:53:52,174 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338 src: /127.0.0.1:54039 dest: /127.0.0.1:50539
2015-02-12 14:53:52,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338 src: /127.0.0.1:54040 dest: /127.0.0.1:50543
2015-02-12 14:53:52,211 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54040, dest: /127.0.0.1:50543, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0030_r_000000_0_-1364606385_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338, duration: 34529000
2015-02-12 14:53:52,212 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:52,212 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,212 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54039, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0030_r_000000_0_-1364606385_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338, duration: 35473000
2015-02-12 14:53:52,212 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,213 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54038, dest: /127.0.0.1:50546, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0030_r_000000_0_-1364606385_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338, duration: 36448000
2015-02-12 14:53:52,213 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,213 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,214 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,218 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 2701 Total time for transactions(ms): 220 Number of transactions batched in Syncs: 9 Number of syncs: 1873 SyncTimes(ms): 638 451
2015-02-12 14:53:52,219 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0030_r_000000_0_-1364606385_1
2015-02-12 14:53:52,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:53:52,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:53:52,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/task_1423780884992_0030_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:53:52,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1423780884992_0030_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/task_1423780884992_0030_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:53:52,268 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:52,271 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000010
2015-02-12 14:53:52,271 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000010
2015-02-12 14:53:52,271 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000010 transitioned from RUNNING to KILLING
2015-02-12 14:53:52,271 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000010
2015-02-12 14:53:52,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,281 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:53:52,296 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0030_01_000010 is : 143
2015-02-12 14:53:52,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:52,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:52,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/task_1423780884992_0030_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:53:52,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:52,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary/1/task_1423780884992_0030_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,316 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:53:52,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000010
2015-02-12 14:53:52,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000010
2015-02-12 14:53:52,319 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000010
2015-02-12 14:53:52,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000010
2015-02-12 14:53:52,321 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000010
2015-02-12 14:53:52,321 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:53:52,321 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000010 from application application_1423780884992_0030
2015-02-12 14:53:52,322 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:52,322 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:52,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary dst=null perm=null proto=rpc
2015-02-12 14:53:52,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,333 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,337 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,366 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54009, dest: /127.0.0.1:50543, bytes: 75527, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337, duration: 6151881000
2015-02-12 14:53:52,367 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:52,370 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 17012
2015-02-12 14:53:52,371 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54008, dest: /127.0.0.1:50549, bytes: 75527, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337, duration: 6154229000
2015-02-12 14:53:52,371 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,377 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 17012
2015-02-12 14:53:52,378 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54007, dest: /127.0.0.1:50546, bytes: 75527, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337, duration: 6163346000
2015-02-12 14:53:52,379 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,387 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 17012
2015-02-12 14:53:52,394 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,400 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:53:52,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339 src: /127.0.0.1:54042 dest: /127.0.0.1:50543
2015-02-12 14:53:52,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339 src: /127.0.0.1:54043 dest: /127.0.0.1:50546
2015-02-12 14:53:52,406 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339 src: /127.0.0.1:54044 dest: /127.0.0.1:50549
2015-02-12 14:53:52,410 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54044, dest: /127.0.0.1:50549, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339, duration: 1733000
2015-02-12 14:53:52,410 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:52,411 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,411 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54043, dest: /127.0.0.1:50546, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339, duration: 2196000
2015-02-12 14:53:52,411 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,411 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,412 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54042, dest: /127.0.0.1:50543, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339, duration: 3596000
2015-02-12 14:53:52,412 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,412 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,414 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary_tmp is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:52,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:53:52,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:52,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:53:52,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:52,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:53:52,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,443 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:53:52,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340 src: /127.0.0.1:54046 dest: /127.0.0.1:50546
2015-02-12 14:53:52,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340 src: /127.0.0.1:54047 dest: /127.0.0.1:50543
2015-02-12 14:53:52,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340 src: /127.0.0.1:54048 dest: /127.0.0.1:50549
2015-02-12 14:53:52,456 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54048, dest: /127.0.0.1:50549, bytes: 75527, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340, duration: 2076000
2015-02-12 14:53:52,457 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:52,459 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:53:52,459 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54047, dest: /127.0.0.1:50543, bytes: 75527, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340, duration: 5325000
2015-02-12 14:53:52,459 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,460 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,460 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54046, dest: /127.0.0.1:50546, bytes: 75527, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340, duration: 6508000
2015-02-12 14:53:52,460 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,461 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,463 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:52,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:53:52,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:52,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:53:52,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:53:52,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030/job_1423780884992_0030_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:53:52,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:52,489 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:53:52,491 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341 src: /127.0.0.1:54050 dest: /127.0.0.1:50549
2015-02-12 14:53:52,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341 src: /127.0.0.1:54051 dest: /127.0.0.1:50543
2015-02-12 14:53:52,494 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341 src: /127.0.0.1:54052 dest: /127.0.0.1:50546
2015-02-12 14:53:52,498 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54052, dest: /127.0.0.1:50546, bytes: 114140, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341, duration: 2013000
2015-02-12 14:53:52,498 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:52,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,499 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54051, dest: /127.0.0.1:50543, bytes: 114140, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341, duration: 2874000
2015-02-12 14:53:52,499 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,500 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54050, dest: /127.0.0.1:50549, bytes: 114140, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-877162338_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341, duration: 4148000
2015-02-12 14:53:52,501 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:52,503 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:52,508 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-877162338_1
2015-02-12 14:53:52,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:52,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:52,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:52,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:53:52,533 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0030_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:53:52,533 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:53:52,533 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0030 with final state: FINISHING
2015-02-12 14:53:52,534 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from RUNNING to FINAL_SAVING
2015-02-12 14:53:52,537 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0030
2015-02-12 14:53:52,538 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:53:52,538 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from FINAL_SAVING to FINISHING
2015-02-12 14:53:53,275 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:53,276 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 14:53:53,276 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000010
2015-02-12 14:53:53,276 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:53:53,276 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000010 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:53:53,541 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0030 unregistered successfully.
2015-02-12 14:53:53,545 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742155_1331 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:53:53,545 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742156_1332 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:53:53,545 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742157_1333 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:53:53,545 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742158_1334 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:53:53,546 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742160_1336 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:53:53,546 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742161_1337 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:53:53,546 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742159_1335 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:53:53,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0030 dst=null perm=null proto=rpc
2015-02-12 14:53:53,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,587 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary
2015-02-12 14:53:53,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/_temporary dst=null perm=null proto=rpc
2015-02-12 14:53:53,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,601 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:53,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:53,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,623 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:53,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:53,630 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes
2015-02-12 14:53:53,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes dst=null perm=null proto=rpc
2015-02-12 14:53:53,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:53,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:53:53,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:53:53,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:53,655 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:53:53,657 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:53:53,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch"]
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 2
2015-02-12 14:53:53,689 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 2
2015-02-12 14:53:53,702 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/2)
2015-02-12 14:53:53,717 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:53:53,733 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:53:53,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:53:53,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:53,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:53,743 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 31
2015-02-12 14:53:53,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031 dst=null perm=null proto=rpc
2015-02-12 14:53:53,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:53:53,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:53:53,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,756 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:53:53,757 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 src: /127.0.0.1:54060 dest: /127.0.0.1:50543
2015-02-12 14:53:53,759 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 src: /127.0.0.1:54061 dest: /127.0.0.1:50546
2015-02-12 14:53:53,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 src: /127.0.0.1:54062 dest: /127.0.0.1:50549
2015-02-12 14:53:53,765 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54062, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342, duration: 3298000
2015-02-12 14:53:53,765 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:53,766 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54061, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342, duration: 3328000
2015-02-12 14:53:53,766 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,766 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:53:53,767 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54060, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342, duration: 4695000
2015-02-12 14:53:53,767 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,768 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:53:53,770 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,773 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:53,774 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar
2015-02-12 14:53:53,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:53:53,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:53:53,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:53:53,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:53:53,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:53:53,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:53,788 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:53:53,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:53:53,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,795 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split
2015-02-12 14:53:53,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:53,796 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:53:53,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343 src: /127.0.0.1:54063 dest: /127.0.0.1:50539
2015-02-12 14:53:53,799 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343 src: /127.0.0.1:54064 dest: /127.0.0.1:50549
2015-02-12 14:53:53,800 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343 src: /127.0.0.1:54065 dest: /127.0.0.1:50546
2015-02-12 14:53:53,801 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343 src: /127.0.0.1:54066 dest: /127.0.0.1:50543
2015-02-12 14:53:53,805 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54066, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, duration: 2242000
2015-02-12 14:53:53,805 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:53,806 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:53:53,806 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54065, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, duration: 2777000
2015-02-12 14:53:53,806 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,807 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54064, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, duration: 4072000
2015-02-12 14:53:53,807 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,808 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,808 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54063, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, duration: 5389000
2015-02-12 14:53:53,808 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,812 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,814 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,816 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:53,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,821 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:53:53,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344 src: /127.0.0.1:54067 dest: /127.0.0.1:50539
2015-02-12 14:53:53,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344 src: /127.0.0.1:54068 dest: /127.0.0.1:50546
2015-02-12 14:53:53,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344 src: /127.0.0.1:54069 dest: /127.0.0.1:50543
2015-02-12 14:53:53,829 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54069, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344, duration: 1140000
2015-02-12 14:53:53,829 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:53,830 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:53,830 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54068, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344, duration: 1679000
2015-02-12 14:53:53,830 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,832 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54067, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344, duration: 3086000
2015-02-12 14:53:53,832 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,832 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,840 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,841 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:53,841 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:53:53,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:53:53,853 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:53:53,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345 src: /127.0.0.1:54070 dest: /127.0.0.1:50546
2015-02-12 14:53:53,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345 src: /127.0.0.1:54071 dest: /127.0.0.1:50543
2015-02-12 14:53:53,861 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345 src: /127.0.0.1:54072 dest: /127.0.0.1:50549
2015-02-12 14:53:53,867 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54072, dest: /127.0.0.1:50549, bytes: 96650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345, duration: 2924000
2015-02-12 14:53:53,867 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:53,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:53:53,868 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54071, dest: /127.0.0.1:50543, bytes: 96650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345, duration: 3687000
2015-02-12 14:53:53,868 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,871 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54070, dest: /127.0.0.1:50546, bytes: 96650, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345, duration: 5764000
2015-02-12 14:53:53,871 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:53,871 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,872 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:53,873 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:53:53,874 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0031
2015-02-12 14:53:53,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031 dst=null perm=null proto=rpc
2015-02-12 14:53:53,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:53,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:53,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:53,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:53,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:53,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:53,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:53:53,887 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 31 submitted by user soberoi
2015-02-12 14:53:53,887 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0031
2015-02-12 14:53:53,887 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from NEW to NEW_SAVING
2015-02-12 14:53:53,887 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0031
2015-02-12 14:53:53,887 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0031
2015-02-12 14:53:53,888 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:53:53,888 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0031 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:53:53,889 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from SUBMITTED to ACCEPTED
2015-02-12 14:53:53,889 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0031
2015-02-12 14:53:53,890 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0031_000001
2015-02-12 14:53:53,890 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from NEW to SUBMITTED
2015-02-12 14:53:53,890 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0031_000001 to scheduler from user: soberoi
2015-02-12 14:53:53,891 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:53:53,893 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0031/
2015-02-12 14:53:53,893 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0031
2015-02-12 14:53:53,893 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0031/
2015-02-12 14:53:54,278 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:54,279 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:53:54,279 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000001
2015-02-12 14:53:54,279 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:53:54,280 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0031_01_000001
2015-02-12 14:53:54,280 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:53:54,280 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0031_000001
2015-02-12 14:53:54,280 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0031 AttemptId: appattempt_1423780884992_0031_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0031_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:53:54,280 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:53:54,281 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:53:54,281 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0031_000001
2015-02-12 14:53:54,283 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0031_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0031_000001
2015-02-12 14:53:54,283 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0031_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:53:54,283 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0031_000001
2015-02-12 14:53:54,283 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0031_000001
2015-02-12 14:53:54,288 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:53:54,290 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000001 by user soberoi
2015-02-12 14:53:54,290 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0031
2015-02-12 14:53:54,291 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000001
2015-02-12 14:53:54,291 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from NEW to INITING
2015-02-12 14:53:54,291 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000001 to application application_1423780884992_0031
2015-02-12 14:53:54,291 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0031_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0031_000001
2015-02-12 14:53:54,291 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from INITING to RUNNING
2015-02-12 14:53:54,291 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:53:54,291 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:53:54,291 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:53:54,292 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:53:54,292 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:53:54,292 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:53:54,292 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:53:54,292 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0031_01_000001
2015-02-12 14:53:54,303 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0031_01_000001.tokens. Credentials list:
2015-02-12 14:53:54,468 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:53:54,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0031_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000001.tokens
2015-02-12 14:53:54,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:53:54,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:54,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:53:54,769 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:54,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:54,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:54,867 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0031/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:54,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:54,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:53:54,968 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:55,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:55,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:53:55,047 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:53:55,047 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:53:55,086 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:53:55,086 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:55,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000001/default_container_executor.sh]
2015-02-12 14:53:55,272 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742166_1342 to datanode(s) 127.0.0.1:50539
2015-02-12 14:53:55,273 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742155_1331, blk_1073742156_1332, blk_1073742157_1333, blk_1073742158_1334, blk_1073742159_1335]
2015-02-12 14:53:55,273 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742155_1331, blk_1073742156_1332, blk_1073742157_1333, blk_1073742158_1334]
2015-02-12 14:53:55,280 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:53:55,280 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742160 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742161 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742160
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742157_1333 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742157 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742158 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742159 for deletion
2015-02-12 14:53:56,063 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742161
2015-02-12 14:53:56,064 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156
2015-02-12 14:53:56,064 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155
2015-02-12 14:53:56,064 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742158
2015-02-12 14:53:56,064 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742157_1333 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742157
2015-02-12 14:53:56,064 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742159
2015-02-12 14:53:56,280 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:56,425 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 to 127.0.0.1:50539
2015-02-12 14:53:56,427 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 src: /127.0.0.1:54076 dest: /127.0.0.1:50539
2015-02-12 14:53:56,427 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:53:56,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342 src: /127.0.0.1:54076 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:53:56,429 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742166_1342 size 254067
2015-02-12 14:53:56,690 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742160 for deletion
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742161 for deletion
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155 for deletion
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742160
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156 for deletion
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742157_1333 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742157 for deletion
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742161
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742158 for deletion
2015-02-12 14:53:56,691 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156
2015-02-12 14:53:56,692 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742157_1333 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742157
2015-02-12 14:53:56,692 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742158
2015-02-12 14:53:57,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:53:57,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:53:57,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:53:57,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:53:57,284 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:57,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031 dst=null perm=null proto=rpc
2015-02-12 14:53:57,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:53:57,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:53:57,425 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339
2015-02-12 14:53:57,427 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338
2015-02-12 14:53:57,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:57,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:53:58,044 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339
2015-02-12 14:53:58,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742161_1337
2015-02-12 14:53:58,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338
2015-02-12 14:53:58,046 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341
2015-02-12 14:53:58,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340
2015-02-12 14:53:58,270 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742163_1339
2015-02-12 14:53:58,271 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341
2015-02-12 14:53:58,272 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340
2015-02-12 14:53:58,275 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742155_1331, blk_1073742156_1332, blk_1073742158_1334, blk_1073742159_1335]
2015-02-12 14:53:58,275 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742155_1331, blk_1073742156_1332, blk_1073742157_1333, blk_1073742159_1335]
2015-02-12 14:53:58,287 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:58,678 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:53:58,681 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0031_000001
2015-02-12 14:53:58,681 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0031 APPATTEMPTID=appattempt_1423780884992_0031_000001
2015-02-12 14:53:58,681 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:53:58,682 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from ACCEPTED to RUNNING
2015-02-12 14:53:58,696 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0030_01_000001 succeeded
2015-02-12 14:53:58,696 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:53:58,696 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0030_01_000001
2015-02-12 14:53:58,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000001
2015-02-12 14:53:58,727 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000001
2015-02-12 14:53:58,729 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000001
2015-02-12 14:53:58,730 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0030/container_1423780884992_0030_01_000001
2015-02-12 14:53:58,730 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000001
2015-02-12 14:53:58,730 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0030_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:53:58,731 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0030_01_000001 from application application_1423780884992_0030
2015-02-12 14:53:58,731 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:53:58,731 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0030
2015-02-12 14:53:58,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:58,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:53:58,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155 for deletion
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156 for deletion
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742157_1333 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742157 for deletion
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742159 for deletion
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156
2015-02-12 14:53:59,111 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742157_1333 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742157
2015-02-12 14:53:59,112 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742159
2015-02-12 14:53:59,157 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:53:59,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346 src: /127.0.0.1:54084 dest: /127.0.0.1:50546
2015-02-12 14:53:59,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346 src: /127.0.0.1:54085 dest: /127.0.0.1:50539
2015-02-12 14:53:59,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346 src: /127.0.0.1:54086 dest: /127.0.0.1:50543
2015-02-12 14:53:59,258 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54086, dest: /127.0.0.1:50543, bytes: 113479, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346, duration: 32338000
2015-02-12 14:53:59,258 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:59,259 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:59,259 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54085, dest: /127.0.0.1:50539, bytes: 113479, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346, duration: 32947000
2015-02-12 14:53:59,260 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:59,260 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:53:59,261 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54084, dest: /127.0.0.1:50546, bytes: 113479, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346, duration: 34235000
2015-02-12 14:53:59,262 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:59,265 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:59,271 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:53:59,289 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0030_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:53:59,289 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0030_000001
2015-02-12 14:53:59,289 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0030_000001
2015-02-12 14:53:59,290 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0030_000001 State change from FINISHING to FINISHED
2015-02-12 14:53:59,291 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0030 State change from FINISHING to FINISHED
2015-02-12 14:53:59,291 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0030
2015-02-12 14:53:59,289 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0030_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:53:59,291 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000001
2015-02-12 14:53:59,291 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0030,name=[48A2D4029AC8491A91F5440CE69B5AB9/B20B162CA1A647689C2B8C5DFC99EACE] tail/(1/1) ...ipesplatform/renamedpipes,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0030/jobhistory/job/job_1423780884992_0030,appMasterHost=10.1.1.67,startTime=1423781604135,finishTime=1423781632533,finalStatus=SUCCEEDED
2015-02-12 14:53:59,291 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0030_000001
2015-02-12 14:53:59,291 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0030_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:53:59,292 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0030_000001 released container container_1423780884992_0030_01_000001 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:53:59,292 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:59,292 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0030_000001 is done. finalState=FINISHED
2015-02-12 14:53:59,292 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0030 requests cleared
2015-02-12 14:53:59,294 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0030_000001 (auth:SIMPLE)
2015-02-12 14:53:59,296 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0030_01_000001
2015-02-12 14:53:59,297 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0030 CONTAINERID=container_1423780884992_0030_01_000001
2015-02-12 14:53:59,297 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0030_01_000001]
2015-02-12 14:53:59,298 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:59,298 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:59,298 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:53:59,299 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,299 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,300 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0030
2015-02-12 14:53:59,300 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:59,300 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0030, with delay of 10800 seconds
2015-02-12 14:53:59,300 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,301 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:53:59,317 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:53:59,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347 src: /127.0.0.1:54088 dest: /127.0.0.1:50543
2015-02-12 14:53:59,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347 src: /127.0.0.1:54089 dest: /127.0.0.1:50539
2015-02-12 14:53:59,323 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347 src: /127.0.0.1:54090 dest: /127.0.0.1:50549
2015-02-12 14:53:59,326 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54090, dest: /127.0.0.1:50549, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347, duration: 1539000
2015-02-12 14:53:59,326 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:53:59,327 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54089, dest: /127.0.0.1:50539, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347, duration: 2205000
2015-02-12 14:53:59,327 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:59,327 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:53:59,329 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54088, dest: /127.0.0.1:50543, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347, duration: 3872000
2015-02-12 14:53:59,329 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:53:59,329 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:59,330 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:53:59,335 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031.summary is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:53:59,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742160 for deletion
2015-02-12 14:53:59,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742161 for deletion
2015-02-12 14:53:59,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155 for deletion
2015-02-12 14:53:59,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156 for deletion
2015-02-12 14:53:59,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742158 for deletion
2015-02-12 14:53:59,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742159 for deletion
2015-02-12 14:53:59,429 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742160
2015-02-12 14:53:59,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742161
2015-02-12 14:53:59,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742155
2015-02-12 14:53:59,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742156_1332 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742156
2015-02-12 14:53:59,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742158
2015-02-12 14:53:59,430 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742159
2015-02-12 14:53:59,603 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:59,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,604 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0030
2015-02-12 14:53:59,604 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:59,604 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0030, with delay of 10800 seconds
2015-02-12 14:53:59,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,661 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:59,662 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,662 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,663 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0030
2015-02-12 14:53:59,663 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:59,663 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0030, with delay of 10800 seconds
2015-02-12 14:53:59,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,732 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:53:59,733 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,733 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,734 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0030
2015-02-12 14:53:59,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:53:59,734 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:53:59,735 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0030, with delay of 10800 seconds
2015-02-12 14:53:59,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0030
2015-02-12 14:54:00,303 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:00,303 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:00,303 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000002
2015-02-12 14:54:00,303 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:54:00,609 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:00,609 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000003
2015-02-12 14:54:00,609 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:00,666 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:00,666 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000004
2015-02-12 14:54:00,666 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:00,733 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:00,733 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000005
2015-02-12 14:54:00,734 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:00,795 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0031_01_000002
2015-02-12 14:54:00,796 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:00,796 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0031_01_000003
2015-02-12 14:54:00,796 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:00,796 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0031_01_000004
2015-02-12 14:54:00,796 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:00,797 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0031_01_000005
2015-02-12 14:54:00,797 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:00,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:00,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:00,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:00,958 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:00,958 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:00,958 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:00,958 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:00,961 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000004 by user soberoi
2015-02-12 14:54:00,962 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0031
2015-02-12 14:54:00,962 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000004
2015-02-12 14:54:00,962 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000005 by user soberoi
2015-02-12 14:54:00,962 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0031
2015-02-12 14:54:00,963 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000005
2015-02-12 14:54:00,962 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000003 by user soberoi
2015-02-12 14:54:00,963 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0031
2015-02-12 14:54:00,963 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000003
2015-02-12 14:54:00,963 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from NEW to INITING
2015-02-12 14:54:00,964 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000005 to application application_1423780884992_0031
2015-02-12 14:54:00,964 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from NEW to INITING
2015-02-12 14:54:00,964 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from INITING to RUNNING
2015-02-12 14:54:00,963 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000002 by user soberoi
2015-02-12 14:54:00,964 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:54:00,964 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,964 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,964 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:00,962 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from NEW to INITING
2015-02-12 14:54:00,964 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000002 to application application_1423780884992_0031
2015-02-12 14:54:00,965 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:54:00,965 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,965 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,965 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:00,965 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0031
2015-02-12 14:54:00,964 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000004 to application application_1423780884992_0031
2015-02-12 14:54:00,966 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from INITING to RUNNING
2015-02-12 14:54:00,964 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0031
2015-02-12 14:54:00,966 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:54:00,966 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,966 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,966 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:00,964 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000002
2015-02-12 14:54:00,964 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000003 to application application_1423780884992_0031
2015-02-12 14:54:00,967 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from INITING to RUNNING
2015-02-12 14:54:00,967 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:54:00,967 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,967 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0031
2015-02-12 14:54:00,968 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:00,968 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:00,966 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:00,969 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:00,966 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:00,969 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0031_01_000005
2015-02-12 14:54:00,969 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0031_01_000004
2015-02-12 14:54:00,968 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0031
2015-02-12 14:54:00,970 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:00,970 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0031
2015-02-12 14:54:00,970 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:00,970 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:00,970 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0031_01_000003
2015-02-12 14:54:01,014 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0031_01_000004.tokens. Credentials list:
2015-02-12 14:54:01,019 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0031_01_000005.tokens. Credentials list:
2015-02-12 14:54:01,021 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0031_01_000003.tokens. Credentials list:
2015-02-12 14:54:01,074 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:01,074 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:01,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:01,287 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:01,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:01,303 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:01,304 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:01,304 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000006
2015-02-12 14:54:01,304 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:54:01,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000002/default_container_executor.sh]
2015-02-12 14:54:01,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0031_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000003.tokens
2015-02-12 14:54:01,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:01,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0031_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000004.tokens
2015-02-12 14:54:01,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:01,494 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423780884992_0031_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000005.tokens
2015-02-12 14:54:01,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:01,615 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:01,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:01,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:01,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:01,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:01,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:01,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:01,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:01,734 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:01,737 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0031/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:01,746 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0031/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:01,759 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0031/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:01,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:01,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:01,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:01,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:01,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:01,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:01,813 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:01,822 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:01,828 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000006 by user soberoi
2015-02-12 14:54:01,828 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000006
2015-02-12 14:54:01,828 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000006 to application application_1423780884992_0031
2015-02-12 14:54:01,828 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:54:01,828 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:54:01,828 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0031
2015-02-12 14:54:01,828 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:01,828 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0031
2015-02-12 14:54:01,829 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:01,849 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0031/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:01,849 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:01,862 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0031/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:01,863 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:01,879 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0031/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:01,879 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:01,886 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:01,886 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:01,919 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:01,919 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:01,925 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:01,925 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:01,957 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:01,957 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:02,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000006/default_container_executor.sh]
2015-02-12 14:54:02,141 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000005/default_container_executor.sh]
2015-02-12 14:54:02,144 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000004/default_container_executor.sh]
2015-02-12 14:54:02,210 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343
2015-02-12 14:54:02,211 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742162_1338
2015-02-12 14:54:02,211 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344
2015-02-12 14:54:02,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342
2015-02-12 14:54:02,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000003/default_container_executor.sh]
2015-02-12 14:54:02,308 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:02,308 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0031
2015-02-12 14:54:02,308 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:54:02,308 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0031_01_000007 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@797b613c
2015-02-12 14:54:02,435 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344
2015-02-12 14:54:02,436 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342
2015-02-12 14:54:02,437 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343
2015-02-12 14:54:02,438 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742164_1340
2015-02-12 14:54:02,617 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:02,617 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000008
2015-02-12 14:54:02,617 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:54:02,637 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345
2015-02-12 14:54:02,638 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742165_1341
2015-02-12 14:54:02,820 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:54:02,821 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:03,254 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343
2015-02-12 14:54:03,255 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742168_1344
2015-02-12 14:54:03,256 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342
2015-02-12 14:54:03,257 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345
2015-02-12 14:54:03,276 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742167_1343
2015-02-12 14:54:03,277 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742166_1342
2015-02-12 14:54:03,310 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0031_000001 on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096
2015-02-12 14:54:03,310 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0031 unreserved on node host: 10.1.1.67:50575 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:54:03,480 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742169_1345
2015-02-12 14:54:03,825 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:54:03,825 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:54:03,825 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000008
2015-02-12 14:54:03,825 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:54:03,825 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000008 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:54:04,624 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0031_01_000008
2015-02-12 14:54:07,217 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347
2015-02-12 14:54:07,218 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346
2015-02-12 14:54:07,642 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347
2015-02-12 14:54:07,643 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346
2015-02-12 14:54:08,263 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742170_1346
2015-02-12 14:54:08,489 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742171_1347
2015-02-12 14:54:09,602 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30002 milliseconds
2015-02-12 14:54:09,602 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:54:10,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:11,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:11,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:11,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:11,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:11,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:11,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:11,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:11,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:11,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:12,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:54:12,095 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:12,096 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000002
2015-02-12 14:54:12,096 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000002
2015-02-12 14:54:12,096 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:54:12,097 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000002
2015-02-12 14:54:12,118 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:54:12,119 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0031_01_000002 is : 143
2015-02-12 14:54:12,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348 src: /127.0.0.1:54127 dest: /127.0.0.1:50539
2015-02-12 14:54:12,127 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348 src: /127.0.0.1:54128 dest: /127.0.0.1:50546
2015-02-12 14:54:12,128 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348 src: /127.0.0.1:54129 dest: /127.0.0.1:50543
2015-02-12 14:54:12,150 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:12,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000002
2015-02-12 14:54:12,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000002
2015-02-12 14:54:12,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000002
2015-02-12 14:54:12,152 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000002
2015-02-12 14:54:12,152 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:12,152 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000002 from application application_1423780884992_0031
2015-02-12 14:54:12,152 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:12,152 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000002
2015-02-12 14:54:12,152 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist for DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:12,152 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:12,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:54:12,395 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:12,397 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000006
2015-02-12 14:54:12,397 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000006
2015-02-12 14:54:12,397 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:54:12,397 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000006
2015-02-12 14:54:12,398 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:12,398 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:54:12,398 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000002
2015-02-12 14:54:12,398 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:54:12,398 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000002 on node: host: 10.1.1.67:50575 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:54:12,419 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0031_01_000006 is : 143
2015-02-12 14:54:12,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:54:12,432 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:12,433 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000006
2015-02-12 14:54:12,434 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000006
2015-02-12 14:54:12,435 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000006
2015-02-12 14:54:12,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000006
2015-02-12 14:54:12,436 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000006
2015-02-12 14:54:12,436 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:12,437 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000006 from application application_1423780884992_0031
2015-02-12 14:54:12,437 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:12,437 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:12,468 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:12,470 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000005
2015-02-12 14:54:12,471 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000005
2015-02-12 14:54:12,471 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:54:12,471 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000005
2015-02-12 14:54:12,491 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0031_01_000005 is : 143
2015-02-12 14:54:12,508 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:12,510 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000005
2015-02-12 14:54:12,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000005
2015-02-12 14:54:12,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000005
2015-02-12 14:54:12,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000005
2015-02-12 14:54:12,512 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000005
2015-02-12 14:54:12,513 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:12,513 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000005 from application application_1423780884992_0031
2015-02-12 14:54:12,513 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:12,513 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:12,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:54:12,560 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:12,562 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000004
2015-02-12 14:54:12,562 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000004
2015-02-12 14:54:12,562 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:54:12,562 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000004
2015-02-12 14:54:12,586 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0031_01_000004 is : 143
2015-02-12 14:54:12,593 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:12,594 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000004
2015-02-12 14:54:12,595 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000004
2015-02-12 14:54:12,595 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000004
2015-02-12 14:54:12,595 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000004
2015-02-12 14:54:12,596 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000004
2015-02-12 14:54:12,596 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:12,599 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000004 from application application_1423780884992_0031
2015-02-12 14:54:12,599 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:12,599 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:12,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:54:12,676 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:12,678 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000003
2015-02-12 14:54:12,678 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000003
2015-02-12 14:54:12,678 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:54:12,679 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000003
2015-02-12 14:54:12,698 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0031_01_000003 is : 143
2015-02-12 14:54:12,706 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:12,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000003
2015-02-12 14:54:12,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000003
2015-02-12 14:54:12,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000003
2015-02-12 14:54:12,708 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000003
2015-02-12 14:54:12,708 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000003
2015-02-12 14:54:12,708 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:12,708 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000003 from application application_1423780884992_0031
2015-02-12 14:54:12,708 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:12,708 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:13,402 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:13,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:13,403 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:54:13,403 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000006
2015-02-12 14:54:13,403 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:54:13,403 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000006 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:54:13,473 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:13,474 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:54:13,474 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000005
2015-02-12 14:54:13,474 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:13,474 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000005 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:13,566 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:13,566 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:54:13,567 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000004
2015-02-12 14:54:13,567 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:13,567 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:13,684 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:13,684 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:54:13,685 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000003
2015-02-12 14:54:13,685 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:13,685 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:14,405 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0031_01_000002]
2015-02-12 14:54:14,405 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:14,405 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:14,405 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:14,406 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000009
2015-02-12 14:54:14,406 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0031_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:54:14,475 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:14,571 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:14,687 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:14,882 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:14,893 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:14,895 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0031_01_000009 by user soberoi
2015-02-12 14:54:14,895 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000009
2015-02-12 14:54:14,895 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0031_01_000009 to application application_1423780884992_0031
2015-02-12 14:54:14,895 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:54:14,895 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0031
2015-02-12 14:54:14,895 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0031
2015-02-12 14:54:14,896 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:14,896 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0031
2015-02-12 14:54:14,896 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:14,925 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:14,925 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:15,030 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000009/default_container_executor.sh]
2015-02-12 14:54:15,409 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0031_01_000006]
2015-02-12 14:54:15,409 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:15,409 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:15,479 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0031_01_000005]
2015-02-12 14:54:15,480 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:15,574 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0031_01_000004]
2015-02-12 14:54:15,574 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:15,701 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0031_01_000003]
2015-02-12 14:54:15,701 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:15,889 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:54:17,639 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:17,645 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:17,649 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:17,652 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:17,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:17,940 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:54:18,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349 src: /127.0.0.1:54141 dest: /127.0.0.1:50543
2015-02-12 14:54:18,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349 src: /127.0.0.1:54142 dest: /127.0.0.1:50539
2015-02-12 14:54:18,047 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349 src: /127.0.0.1:54143 dest: /127.0.0.1:50549
2015-02-12 14:54:18,083 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54143, dest: /127.0.0.1:50549, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0031_r_000000_0_-1965174052_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349, duration: 33370000
2015-02-12 14:54:18,083 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:18,084 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54142, dest: /127.0.0.1:50539, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0031_r_000000_0_-1965174052_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349, duration: 34250000
2015-02-12 14:54:18,084 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,084 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,085 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54141, dest: /127.0.0.1:50543, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0031_r_000000_0_-1965174052_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349, duration: 35718000
2015-02-12 14:54:18,085 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,085 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,102 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0031_r_000000_0_-1965174052_1
2015-02-12 14:54:18,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:54:18,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:54:18,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/task_1423780884992_0031_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:54:18,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/_temporary/attempt_1423780884992_0031_r_000000_0 dst=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/task_1423780884992_0031_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:54:18,153 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:18,157 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000009
2015-02-12 14:54:18,157 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000009
2015-02-12 14:54:18,158 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:54:18,158 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000009
2015-02-12 14:54:18,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,172 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:54:18,185 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0031_01_000009 is : 143
2015-02-12 14:54:18,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:18,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:18,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/task_1423780884992_0031_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:54:18,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:18,201 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:18,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000009
2015-02-12 14:54:18,202 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000009
2015-02-12 14:54:18,203 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:18,203 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000009 from application application_1423780884992_0031
2015-02-12 14:54:18,203 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:18,203 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:18,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary/1/task_1423780884992_0031_r_000000/part-00000 dst=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000009
2015-02-12 14:54:18,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000009
2015-02-12 14:54:18,203 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000009
2015-02-12 14:54:18,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_temporary dst=null perm=null proto=rpc
2015-02-12 14:54:18,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,217 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,222 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,244 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54129, dest: /127.0.0.1:50543, bytes: 64897, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348, duration: 6112701000
2015-02-12 14:54:18,245 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:18,253 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16203
2015-02-12 14:54:18,254 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54128, dest: /127.0.0.1:50546, bytes: 64897, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348, duration: 6105255000
2015-02-12 14:54:18,255 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,256 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54127, dest: /127.0.0.1:50539, bytes: 64897, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348, duration: 6107992000
2015-02-12 14:54:18,257 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,259 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16203
2015-02-12 14:54:18,259 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16203
2015-02-12 14:54:18,261 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,266 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:54:18,268 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350 src: /127.0.0.1:54145 dest: /127.0.0.1:50543
2015-02-12 14:54:18,269 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350 src: /127.0.0.1:54146 dest: /127.0.0.1:50549
2015-02-12 14:54:18,271 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350 src: /127.0.0.1:54147 dest: /127.0.0.1:50546
2015-02-12 14:54:18,274 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54147, dest: /127.0.0.1:50546, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350, duration: 1661000
2015-02-12 14:54:18,274 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:18,275 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,275 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54146, dest: /127.0.0.1:50549, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350, duration: 2145000
2015-02-12 14:54:18,276 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,277 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,277 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54145, dest: /127.0.0.1:50543, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350, duration: 4168000
2015-02-12 14:54:18,277 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,278 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,280 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary_tmp is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:18,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:54:18,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:18,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:54:18,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:18,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:54:18,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,319 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:54:18,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351 src: /127.0.0.1:54149 dest: /127.0.0.1:50539
2015-02-12 14:54:18,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351 src: /127.0.0.1:54151 dest: /127.0.0.1:50546
2015-02-12 14:54:18,327 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351 src: /127.0.0.1:54152 dest: /127.0.0.1:50549
2015-02-12 14:54:18,336 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54152, dest: /127.0.0.1:50549, bytes: 64897, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351, duration: 7476000
2015-02-12 14:54:18,337 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:18,338 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54151, dest: /127.0.0.1:50546, bytes: 64897, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351, duration: 8201000
2015-02-12 14:54:18,338 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:54:18,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,340 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54149, dest: /127.0.0.1:50539, bytes: 64897, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351, duration: 10913000
2015-02-12 14:54:18,341 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,346 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:18,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:54:18,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:18,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:54:18,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:18,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031/job_1423780884992_0031_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:54:18,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:18,368 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:54:18,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352 src: /127.0.0.1:54154 dest: /127.0.0.1:50543
2015-02-12 14:54:18,371 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352 src: /127.0.0.1:54155 dest: /127.0.0.1:50546
2015-02-12 14:54:18,373 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352 src: /127.0.0.1:54156 dest: /127.0.0.1:50539
2015-02-12 14:54:18,376 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54156, dest: /127.0.0.1:50539, bytes: 113479, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352, duration: 2053000
2015-02-12 14:54:18,376 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:18,377 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,377 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54155, dest: /127.0.0.1:50546, bytes: 113479, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352, duration: 2655000
2015-02-12 14:54:18,377 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,378 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54154, dest: /127.0.0.1:50543, bytes: 113479, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1757944139_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352, duration: 3630000
2015-02-12 14:54:18,378 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,378 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:18,379 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:18,381 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1757944139_1
2015-02-12 14:54:18,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:18,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:18,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:18,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:18,401 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0031_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:54:18,402 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:54:18,402 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0031 with final state: FINISHING
2015-02-12 14:54:18,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from RUNNING to FINAL_SAVING
2015-02-12 14:54:18,403 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:54:18,403 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0031
2015-02-12 14:54:18,404 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from FINAL_SAVING to FINISHING
2015-02-12 14:54:19,164 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:19,164 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:54:19,165 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000009
2015-02-12 14:54:19,165 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:54:19,165 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000009 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:54:19,408 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0031 unregistered successfully.
2015-02-12 14:54:19,412 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742166_1342 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:54:19,412 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742167_1343 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:54:19,413 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742168_1344 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:54:19,413 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742169_1345 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:54:19,413 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742171_1347 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:54:19,413 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742172_1348 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:54:19,413 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742170_1346 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:54:19,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0031 dst=null perm=null proto=rpc
2015-02-12 14:54:19,458 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/2) ...orm/cogroupfilteredbranch
2015-02-12 14:54:19,467 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:54:19,483 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:54:19,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:19,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:54:19,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:54:19,495 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 32
2015-02-12 14:54:19,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032 dst=null perm=null proto=rpc
2015-02-12 14:54:19,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:54:19,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:54:19,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,504 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:54:19,506 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 src: /127.0.0.1:54159 dest: /127.0.0.1:50539
2015-02-12 14:54:19,508 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 src: /127.0.0.1:54160 dest: /127.0.0.1:50543
2015-02-12 14:54:19,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 src: /127.0.0.1:54161 dest: /127.0.0.1:50546
2015-02-12 14:54:19,514 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54161, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353, duration: 3450000
2015-02-12 14:54:19,514 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:19,515 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:54:19,515 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54160, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353, duration: 3509000
2015-02-12 14:54:19,515 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,516 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,517 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54159, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353, duration: 5905000
2015-02-12 14:54:19,518 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,521 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:19,522 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar
2015-02-12 14:54:19,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:54:19,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:54:19,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:54:19,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:54:19,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:54:19,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:19,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:19,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:19,542 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:19,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:19,543 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:19,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:19,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:19,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:19,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:19,547 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:19,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:19,549 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:19,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:19,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,555 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split
2015-02-12 14:54:19,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:19,557 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:54:19,558 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354 src: /127.0.0.1:54162 dest: /127.0.0.1:50539
2015-02-12 14:54:19,560 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354 src: /127.0.0.1:54163 dest: /127.0.0.1:50543
2015-02-12 14:54:19,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354 src: /127.0.0.1:54164 dest: /127.0.0.1:50546
2015-02-12 14:54:19,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354 src: /127.0.0.1:54165 dest: /127.0.0.1:50549
2015-02-12 14:54:19,565 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54165, dest: /127.0.0.1:50549, bytes: 2132, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, duration: 1684000
2015-02-12 14:54:19,565 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:19,566 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54164, dest: /127.0.0.1:50546, bytes: 2132, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, duration: 2335000
2015-02-12 14:54:19,566 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,566 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,568 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54163, dest: /127.0.0.1:50543, bytes: 2132, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, duration: 3852000
2015-02-12 14:54:19,568 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,569 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54162, dest: /127.0.0.1:50539, bytes: 2132, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, duration: 4733000
2015-02-12 14:54:19,569 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,569 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,575 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,575 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,576 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:19,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,583 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:54:19,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355 src: /127.0.0.1:54166 dest: /127.0.0.1:50546
2015-02-12 14:54:19,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355 src: /127.0.0.1:54167 dest: /127.0.0.1:50539
2015-02-12 14:54:19,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355 src: /127.0.0.1:54168 dest: /127.0.0.1:50549
2015-02-12 14:54:19,596 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54168, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355, duration: 1340000
2015-02-12 14:54:19,596 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:19,600 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54167, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355, duration: 5270000
2015-02-12 14:54:19,601 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,602 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54166, dest: /127.0.0.1:50546, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355, duration: 7071000
2015-02-12 14:54:19,602 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,603 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:54:19,604 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:54:19,605 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742179_1355 size 218
2015-02-12 14:54:19,605 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:19,606 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:54:19,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:19,618 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:54:19,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356 src: /127.0.0.1:54169 dest: /127.0.0.1:50539
2015-02-12 14:54:19,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356 src: /127.0.0.1:54170 dest: /127.0.0.1:50543
2015-02-12 14:54:19,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356 src: /127.0.0.1:54171 dest: /127.0.0.1:50546
2015-02-12 14:54:19,628 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54171, dest: /127.0.0.1:50546, bytes: 97827, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356, duration: 4322000
2015-02-12 14:54:19,628 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:19,629 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,629 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54170, dest: /127.0.0.1:50543, bytes: 97827, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356, duration: 2351000
2015-02-12 14:54:19,629 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,630 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54169, dest: /127.0.0.1:50539, bytes: 97827, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356, duration: 5121000
2015-02-12 14:54:19,630 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,630 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:19,631 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:19,632 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:19,633 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0032
2015-02-12 14:54:19,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032 dst=null perm=null proto=rpc
2015-02-12 14:54:19,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:19,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:19,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:19,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:19,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:19,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:19,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:19,654 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 32 submitted by user soberoi
2015-02-12 14:54:19,654 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0032
2015-02-12 14:54:19,655 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0032
2015-02-12 14:54:19,655 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0032
2015-02-12 14:54:19,655 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from NEW to NEW_SAVING
2015-02-12 14:54:19,656 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:54:19,656 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0032 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:54:19,657 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from SUBMITTED to ACCEPTED
2015-02-12 14:54:19,657 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0032_000001
2015-02-12 14:54:19,657 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0032
2015-02-12 14:54:19,657 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from NEW to SUBMITTED
2015-02-12 14:54:19,658 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0032_000001 to scheduler from user: soberoi
2015-02-12 14:54:19,658 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:54:19,661 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0032/
2015-02-12 14:54:19,662 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0032
2015-02-12 14:54:19,662 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0032/
2015-02-12 14:54:19,718 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:19,718 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000001
2015-02-12 14:54:19,718 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:54:19,719 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0032_01_000001
2015-02-12 14:54:19,719 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:19,719 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0032_000001
2015-02-12 14:54:19,720 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0032 AttemptId: appattempt_1423780884992_0032_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0032_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:54:19,720 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:54:19,721 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:54:19,721 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0032_000001
2015-02-12 14:54:19,723 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0032_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0032_000001
2015-02-12 14:54:19,723 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0032_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:54:19,724 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0032_000001
2015-02-12 14:54:19,724 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0032_000001
2015-02-12 14:54:19,726 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:19,728 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000001 by user soberoi
2015-02-12 14:54:19,728 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0032
2015-02-12 14:54:19,729 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000001
2015-02-12 14:54:19,729 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from NEW to INITING
2015-02-12 14:54:19,729 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000001 to application application_1423780884992_0032
2015-02-12 14:54:19,729 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from INITING to RUNNING
2015-02-12 14:54:19,729 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:54:19,729 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:19,730 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:19,730 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:54:19,730 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:54:19,730 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:19,730 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0032_01_000001
2015-02-12 14:54:19,729 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0032_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0032_000001
2015-02-12 14:54:19,730 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:54:19,743 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0032_01_000001.tokens. Credentials list:
2015-02-12 14:54:19,861 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:19,960 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0032_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000001.tokens
2015-02-12 14:54:19,960 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:20,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:20,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:20,113 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:20,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:20,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:20,167 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:20,179 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0032/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:20,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:20,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:20,255 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0032/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:20,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:20,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:20,325 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0032/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:20,325 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:20,365 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:20,366 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:20,493 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000001/default_container_executor.sh]
2015-02-12 14:54:20,721 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:21,168 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:22,171 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:22,306 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50543 to replicate blk_1073742177_1353 to datanode(s) 127.0.0.1:50549
2015-02-12 14:54:22,307 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344, blk_1073742170_1346, blk_1073742171_1347, blk_1073742172_1348]
2015-02-12 14:54:22,307 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344, blk_1073742169_1345, blk_1073742170_1346, blk_1073742171_1347, blk_1073742172_1348]
2015-02-12 14:54:22,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:54:22,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:54:22,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:54:22,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:54:22,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032 dst=null perm=null proto=rpc
2015-02-12 14:54:22,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:54:22,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:54:22,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:22,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:23,084 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 to 127.0.0.1:50549
2015-02-12 14:54:23,084 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166 for deletion
2015-02-12 14:54:23,084 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167 for deletion
2015-02-12 14:54:23,084 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742168 for deletion
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742169 for deletion
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742170_1346 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742170 for deletion
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742171_1347 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742171 for deletion
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742172 for deletion
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742169
2015-02-12 14:54:23,086 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:54:23,085 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166
2015-02-12 14:54:23,087 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742168
2015-02-12 14:54:23,086 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742171_1347 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742171
2015-02-12 14:54:23,087 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742170_1346 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742170
2015-02-12 14:54:23,087 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742172
2015-02-12 14:54:23,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 src: /127.0.0.1:54182 dest: /127.0.0.1:50549
2015-02-12 14:54:23,090 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353 src: /127.0.0.1:54182 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:54:23,091 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742177_1353 size 254067
2015-02-12 14:54:23,132 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166 for deletion
2015-02-12 14:54:23,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167 for deletion
2015-02-12 14:54:23,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742168 for deletion
2015-02-12 14:54:23,133 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742170_1346 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742170 for deletion
2015-02-12 14:54:23,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742171_1347 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742171 for deletion
2015-02-12 14:54:23,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742172 for deletion
2015-02-12 14:54:23,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742168
2015-02-12 14:54:23,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166
2015-02-12 14:54:23,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742170_1346 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742170
2015-02-12 14:54:23,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167
2015-02-12 14:54:23,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742171_1347 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742171
2015-02-12 14:54:23,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742172
2015-02-12 14:54:23,174 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:23,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742172_1348
2015-02-12 14:54:23,504 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350
2015-02-12 14:54:23,505 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351
2015-02-12 14:54:23,505 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349
2015-02-12 14:54:23,957 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:23,959 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0032_000001
2015-02-12 14:54:23,960 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0032 APPATTEMPTID=appattempt_1423780884992_0032_000001
2015-02-12 14:54:23,960 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:54:23,960 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from ACCEPTED to RUNNING
2015-02-12 14:54:24,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:24,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:54:24,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:24,179 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:24,386 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:54:24,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357 src: /127.0.0.1:54188 dest: /127.0.0.1:50546
2015-02-12 14:54:24,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357 src: /127.0.0.1:54189 dest: /127.0.0.1:50543
2015-02-12 14:54:24,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357 src: /127.0.0.1:54190 dest: /127.0.0.1:50539
2015-02-12 14:54:24,487 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0031_01_000001 succeeded
2015-02-12 14:54:24,487 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:54:24,487 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0031_01_000001
2015-02-12 14:54:24,503 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54190, dest: /127.0.0.1:50539, bytes: 114542, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357, duration: 49176000
2015-02-12 14:54:24,503 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:24,504 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:54:24,504 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54189, dest: /127.0.0.1:50543, bytes: 114542, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357, duration: 49825000
2015-02-12 14:54:24,504 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:24,505 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54188, dest: /127.0.0.1:50546, bytes: 114542, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357, duration: 50545000
2015-02-12 14:54:24,505 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:24,505 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:24,506 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:24,508 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000001
2015-02-12 14:54:24,509 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000001
2015-02-12 14:54:24,509 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000001
2015-02-12 14:54:24,509 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0031_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:54:24,509 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0031_01_000001 from application application_1423780884992_0031
2015-02-12 14:54:24,509 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:24,509 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000001
2015-02-12 14:54:24,509 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0031/container_1423780884992_0031_01_000001
2015-02-12 14:54:24,509 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0031
2015-02-12 14:54:24,513 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:24,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:24,553 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:54:24,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358 src: /127.0.0.1:54191 dest: /127.0.0.1:50546
2015-02-12 14:54:24,557 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358 src: /127.0.0.1:54192 dest: /127.0.0.1:50549
2015-02-12 14:54:24,558 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358 src: /127.0.0.1:54193 dest: /127.0.0.1:50539
2015-02-12 14:54:24,561 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54193, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358, duration: 1346000
2015-02-12 14:54:24,561 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:24,562 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:24,562 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54192, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358, duration: 2007000
2015-02-12 14:54:24,562 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:24,563 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54191, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358, duration: 2860000
2015-02-12 14:54:24,563 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:24,564 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:24,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:24,569 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032.summary is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:25,182 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0031_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:25,182 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0031_000001
2015-02-12 14:54:25,183 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0031_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:54:25,183 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0031_000001
2015-02-12 14:54:25,183 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000001
2015-02-12 14:54:25,183 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0031_000001 State change from FINISHING to FINISHED
2015-02-12 14:54:25,183 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0031_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:25,183 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0031_000001 released container container_1423780884992_0031_01_000001 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:25,183 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:25,183 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0031 State change from FINISHING to FINISHED
2015-02-12 14:54:25,184 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:25,184 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000002
2015-02-12 14:54:25,184 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:25,184 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0031_000001 is done. finalState=FINISHED
2015-02-12 14:54:25,184 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0031_000001
2015-02-12 14:54:25,184 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0031 requests cleared
2015-02-12 14:54:25,184 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0031
2015-02-12 14:54:25,185 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0031,name=[672128F228ED4C28AA8F3FCB19B52DB7/4E33F33C634142BAABA432CE5CB7292C] lower*upper/(2/2),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0031/jobhistory/job/job_1423780884992_0031,appMasterHost=10.1.1.67,startTime=1423781633887,finishTime=1423781658402,finalStatus=SUCCEEDED
2015-02-12 14:54:25,187 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0031_000001 (auth:SIMPLE)
2015-02-12 14:54:25,188 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0031_01_000001
2015-02-12 14:54:25,189 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0031 CONTAINERID=container_1423780884992_0031_01_000001
2015-02-12 14:54:25,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0031_01_000001]
2015-02-12 14:54:25,189 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:25,190 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:25,190 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:25,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:25,190 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000003
2015-02-12 14:54:25,190 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:54:25,190 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,191 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0031
2015-02-12 14:54:25,191 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,191 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:25,191 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0031, with delay of 10800 seconds
2015-02-12 14:54:25,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,312 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742166_1342, blk_1073742167_1343, blk_1073742169_1345, blk_1073742171_1347]
2015-02-12 14:54:25,312 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344, blk_1073742169_1345, blk_1073742170_1346, blk_1073742172_1348]
2015-02-12 14:54:25,507 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:25,507 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:25,507 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000004
2015-02-12 14:54:25,507 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:25,508 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,508 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,508 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,509 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0031
2015-02-12 14:54:25,509 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:25,509 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0031, with delay of 10800 seconds
2015-02-12 14:54:25,509 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,590 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:25,591 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:25,591 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000005
2015-02-12 14:54:25,591 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:25,591 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,592 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,592 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,592 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0031
2015-02-12 14:54:25,592 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:25,592 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0031, with delay of 10800 seconds
2015-02-12 14:54:25,592 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,733 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:25,733 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:25,733 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000006
2015-02-12 14:54:25,733 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:54:25,733 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,733 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,734 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0031
2015-02-12 14:54:25,734 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:25,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0031
2015-02-12 14:54:25,734 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0031, with delay of 10800 seconds
2015-02-12 14:54:26,017 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0032_01_000002
2015-02-12 14:54:26,017 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:26,017 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:26,018 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0032_01_000004
2015-02-12 14:54:26,018 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:26,018 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0032_01_000005
2015-02-12 14:54:26,019 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:26,019 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0032_01_000006
2015-02-12 14:54:26,019 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:26,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:26,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:26,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,191 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:26,191 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:26,191 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000007
2015-02-12 14:54:26,191 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:54:26,201 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:26,202 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:26,204 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:26,204 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:26,203 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:26,209 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000002 by user soberoi
2015-02-12 14:54:26,210 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0032
2015-02-12 14:54:26,211 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000002
2015-02-12 14:54:26,211 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from NEW to INITING
2015-02-12 14:54:26,211 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000002 to application application_1423780884992_0032
2015-02-12 14:54:26,211 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from INITING to RUNNING
2015-02-12 14:54:26,211 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:54:26,212 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,212 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,212 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:26,212 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:26,212 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:26,212 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:26,212 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0032_01_000002
2015-02-12 14:54:26,218 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000004 by user soberoi
2015-02-12 14:54:26,218 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0032
2015-02-12 14:54:26,218 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000004
2015-02-12 14:54:26,219 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from NEW to INITING
2015-02-12 14:54:26,219 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000004 to application application_1423780884992_0032
2015-02-12 14:54:26,219 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from INITING to RUNNING
2015-02-12 14:54:26,219 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:54:26,219 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,220 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,220 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:26,220 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:26,220 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:26,220 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:26,220 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0032_01_000004
2015-02-12 14:54:26,223 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000006 by user soberoi
2015-02-12 14:54:26,223 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000006
2015-02-12 14:54:26,223 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000005 by user soberoi
2015-02-12 14:54:26,224 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0032
2015-02-12 14:54:26,224 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000005
2015-02-12 14:54:26,224 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000006 to application application_1423780884992_0032
2015-02-12 14:54:26,224 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:54:26,225 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,225 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,225 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:26,225 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:26,225 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from NEW to INITING
2015-02-12 14:54:26,225 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000005 to application application_1423780884992_0032
2015-02-12 14:54:26,226 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:26,226 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from INITING to RUNNING
2015-02-12 14:54:26,226 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:54:26,226 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,226 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,226 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:26,226 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:26,227 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:26,227 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:26,227 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0032_01_000005
2015-02-12 14:54:26,238 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000003 by user soberoi
2015-02-12 14:54:26,238 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000003
2015-02-12 14:54:26,240 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000003 to application application_1423780884992_0032
2015-02-12 14:54:26,241 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:54:26,241 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,241 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:26,241 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:26,241 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:26,241 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0032_01_000003
2015-02-12 14:54:26,249 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0032_01_000002.tokens. Credentials list:
2015-02-12 14:54:26,249 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0032_01_000004.tokens. Credentials list:
2015-02-12 14:54:26,262 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0032_01_000005.tokens. Credentials list:
2015-02-12 14:54:26,264 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0032_01_000003.tokens. Credentials list:
2015-02-12 14:54:26,288 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:26,288 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:26,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166 for deletion
2015-02-12 14:54:26,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167 for deletion
2015-02-12 14:54:26,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742168 for deletion
2015-02-12 14:54:26,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742169 for deletion
2015-02-12 14:54:26,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742170_1346 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742170 for deletion
2015-02-12 14:54:26,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742172 for deletion
2015-02-12 14:54:26,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166
2015-02-12 14:54:26,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742168
2015-02-12 14:54:26,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167
2015-02-12 14:54:26,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742170_1346 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742170
2015-02-12 14:54:26,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742169
2015-02-12 14:54:26,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742172
2015-02-12 14:54:26,482 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:26,508 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:26,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:26,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:26,591 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:26,613 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000006/default_container_executor.sh]
2015-02-12 14:54:26,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0032_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000002.tokens
2015-02-12 14:54:26,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:26,724 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166 for deletion
2015-02-12 14:54:26,724 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167 for deletion
2015-02-12 14:54:26,724 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742169 for deletion
2015-02-12 14:54:26,724 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742171_1347 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742171 for deletion
2015-02-12 14:54:26,725 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742167
2015-02-12 14:54:26,725 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742166
2015-02-12 14:54:26,725 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742171_1347 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742171
2015-02-12 14:54:26,725 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742169
2015-02-12 14:54:26,735 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:26,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0032_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000005.tokens
2015-02-12 14:54:26,754 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:26,758 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0032_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000004.tokens
2015-02-12 14:54:26,759 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:26,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:26,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:27,002 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0032/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:27,017 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0032/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:27,036 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:27,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:27,042 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0032/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:27,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:27,045 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:27,047 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000007 by user soberoi
2015-02-12 14:54:27,047 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000007
2015-02-12 14:54:27,047 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000007 to application application_1423780884992_0032
2015-02-12 14:54:27,048 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:54:27,048 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:27,048 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:27,048 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:27,048 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:27,049 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0032_01_000007
2015-02-12 14:54:27,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:27,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:27,072 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0032_01_000007.tokens. Credentials list:
2015-02-12 14:54:27,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:27,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:27,147 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:27,147 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:27,148 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:27,148 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:27,169 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0032/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:27,169 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:27,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:27,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:27,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:27,194 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:27,194 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000008
2015-02-12 14:54:27,194 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 14:54:27,200 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:27,201 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:27,210 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:27,210 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:27,210 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:27,210 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:27,222 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:27,222 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:27,234 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352
2015-02-12 14:54:27,234 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354
2015-02-12 14:54:27,234 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349
2015-02-12 14:54:27,254 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:27,254 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:27,270 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:27,270 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:27,437 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353
2015-02-12 14:54:27,439 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351
2015-02-12 14:54:27,506 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000007/default_container_executor.sh]
2015-02-12 14:54:27,515 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000002/default_container_executor.sh]
2015-02-12 14:54:27,533 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000003/default_container_executor.sh]
2015-02-12 14:54:27,544 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000005/default_container_executor.sh]
2015-02-12 14:54:27,554 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000004/default_container_executor.sh]
2015-02-12 14:54:27,640 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356
2015-02-12 14:54:27,641 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355
2015-02-12 14:54:27,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354
2015-02-12 14:54:27,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742173_1349
2015-02-12 14:54:27,663 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350
2015-02-12 14:54:27,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352
2015-02-12 14:54:27,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356
2015-02-12 14:54:27,866 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353
2015-02-12 14:54:28,041 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:54:28,042 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:28,182 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:28,286 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353
2015-02-12 14:54:28,287 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355
2015-02-12 14:54:28,287 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742174_1350
2015-02-12 14:54:28,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0032_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000007.tokens
2015-02-12 14:54:28,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:28,447 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:28,487 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742176_1352
2015-02-12 14:54:28,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742180_1356
2015-02-12 14:54:28,510 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354
2015-02-12 14:54:28,510 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742179_1355
2015-02-12 14:54:28,512 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742177_1353
2015-02-12 14:54:28,597 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0032_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000003.tokens
2015-02-12 14:54:28,598 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:28,686 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742175_1351
2015-02-12 14:54:28,686 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742178_1354
2015-02-12 14:54:29,048 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:54:29,048 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:54:29,049 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000008
2015-02-12 14:54:29,049 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 14:54:29,049 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000008 on node: host: 10.1.1.67:50575 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 14:54:29,200 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0032_01_000008
2015-02-12 14:54:32,644 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358
2015-02-12 14:54:32,646 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357
2015-02-12 14:54:32,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357
2015-02-12 14:54:33,517 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358
2015-02-12 14:54:33,691 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742181_1357
2015-02-12 14:54:33,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742182_1358
2015-02-12 14:54:39,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:39,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:39,604 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30002 milliseconds
2015-02-12 14:54:39,604 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:54:39,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:39,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:39,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:39,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:39,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:40,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:40,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:40,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:40,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:40,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:40,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:40,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:54:40,814 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:40,815 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000006
2015-02-12 14:54:40,816 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000006
2015-02-12 14:54:40,816 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:54:40,816 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000006
2015-02-12 14:54:40,837 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000006 is : 143
2015-02-12 14:54:40,837 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:54:40,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359 src: /127.0.0.1:54251 dest: /127.0.0.1:50546
2015-02-12 14:54:40,845 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359 src: /127.0.0.1:54252 dest: /127.0.0.1:50549
2015-02-12 14:54:40,847 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359 src: /127.0.0.1:54253 dest: /127.0.0.1:50543
2015-02-12 14:54:40,847 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:40,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000006
2015-02-12 14:54:40,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000006
2015-02-12 14:54:40,848 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000006
2015-02-12 14:54:40,848 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:40,848 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000006 from application application_1423780884992_0032
2015-02-12 14:54:40,848 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:40,849 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:40,849 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000006
2015-02-12 14:54:40,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000006
2015-02-12 14:54:40,855 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist for DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:40,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:54:40,978 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:40,980 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000007
2015-02-12 14:54:40,980 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000007
2015-02-12 14:54:40,980 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:54:40,980 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000007
2015-02-12 14:54:41,016 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000007 is : 143
2015-02-12 14:54:41,022 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:41,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000007
2015-02-12 14:54:41,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000007
2015-02-12 14:54:41,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000007
2015-02-12 14:54:41,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000007
2015-02-12 14:54:41,025 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000007
2015-02-12 14:54:41,026 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:41,026 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000007 from application application_1423780884992_0032
2015-02-12 14:54:41,026 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:41,026 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:41,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:54:41,195 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:41,197 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000005
2015-02-12 14:54:41,197 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000005
2015-02-12 14:54:41,197 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:54:41,197 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000005
2015-02-12 14:54:41,217 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000005 is : 143
2015-02-12 14:54:41,227 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:41,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000005
2015-02-12 14:54:41,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000005
2015-02-12 14:54:41,229 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000005
2015-02-12 14:54:41,230 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000005
2015-02-12 14:54:41,230 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000005
2015-02-12 14:54:41,230 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:41,231 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000005 from application application_1423780884992_0032
2015-02-12 14:54:41,231 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:41,232 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:41,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:54:41,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:54:41,336 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:41,338 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000002
2015-02-12 14:54:41,338 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000002
2015-02-12 14:54:41,338 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:54:41,339 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000002
2015-02-12 14:54:41,339 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:41,339 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:54:41,339 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000007
2015-02-12 14:54:41,339 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:54:41,339 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000007 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 14:54:41,358 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000002 is : 143
2015-02-12 14:54:41,374 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:41,375 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000002
2015-02-12 14:54:41,375 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000002
2015-02-12 14:54:41,376 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000002
2015-02-12 14:54:41,377 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000002
2015-02-12 14:54:41,377 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000002
2015-02-12 14:54:41,378 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:41,378 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000002 from application application_1423780884992_0032
2015-02-12 14:54:41,378 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:41,378 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:41,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:54:41,397 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:41,401 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000003
2015-02-12 14:54:41,401 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000003
2015-02-12 14:54:41,402 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:41,402 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:54:41,402 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000002
2015-02-12 14:54:41,403 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:54:41,403 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000002 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:54:41,403 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:41,408 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:54:41,410 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000003
2015-02-12 14:54:41,438 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000003 is : 143
2015-02-12 14:54:41,457 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:41,458 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000003
2015-02-12 14:54:41,458 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000003
2015-02-12 14:54:41,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000003
2015-02-12 14:54:41,460 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000003
2015-02-12 14:54:41,462 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000003
2015-02-12 14:54:41,463 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:41,463 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000003 from application application_1423780884992_0032
2015-02-12 14:54:41,463 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:41,464 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:41,479 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:41,481 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000004
2015-02-12 14:54:41,482 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000004
2015-02-12 14:54:41,482 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:54:41,482 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000004
2015-02-12 14:54:41,502 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000004 is : 143
2015-02-12 14:54:41,512 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:41,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000004
2015-02-12 14:54:41,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000004
2015-02-12 14:54:41,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000004
2015-02-12 14:54:41,514 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000004
2015-02-12 14:54:41,515 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000004
2015-02-12 14:54:41,515 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:41,516 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000004 from application application_1423780884992_0032
2015-02-12 14:54:41,516 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:41,516 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:41,822 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:41,822 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:54:41,822 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000006
2015-02-12 14:54:41,822 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:54:41,822 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000006 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:54:42,201 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:42,201 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:54:42,201 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000005
2015-02-12 14:54:42,202 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:42,202 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000005 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:42,202 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:42,202 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000009
2015-02-12 14:54:42,202 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0032_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:42,402 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:42,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:42,403 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:54:42,403 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000003
2015-02-12 14:54:42,403 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:42,403 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:42,403 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:42,487 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:42,487 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:54:42,487 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000004
2015-02-12 14:54:42,487 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:42,487 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:42,827 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:43,114 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:43,124 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:43,126 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0032_01_000009 by user soberoi
2015-02-12 14:54:43,126 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000009
2015-02-12 14:54:43,126 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0032_01_000009 to application application_1423780884992_0032
2015-02-12 14:54:43,127 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:54:43,127 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0032
2015-02-12 14:54:43,127 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0032
2015-02-12 14:54:43,127 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:43,127 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0032
2015-02-12 14:54:43,128 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:43,164 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:43,164 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:43,205 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:43,205 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:43,325 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000009/default_container_executor.sh]
2015-02-12 14:54:43,403 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0032_01_000002, container_1423780884992_0032_01_000007]
2015-02-12 14:54:43,404 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:43,404 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:43,404 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:43,488 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:43,831 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0032_01_000006]
2015-02-12 14:54:43,832 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:44,120 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:54:44,208 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0032_01_000005]
2015-02-12 14:54:44,208 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:44,404 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0032_01_000003]
2015-02-12 14:54:44,405 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:44,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0032_01_000004]
2015-02-12 14:54:44,493 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:46,589 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:46,593 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:46,595 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:46,598 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:46,606 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:54:46,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:46,944 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:54:47,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360 src: /127.0.0.1:54303 dest: /127.0.0.1:50543
2015-02-12 14:54:47,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360 src: /127.0.0.1:54305 dest: /127.0.0.1:50549
2015-02-12 14:54:47,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360 src: /127.0.0.1:54306 dest: /127.0.0.1:50539
2015-02-12 14:54:47,160 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54306, dest: /127.0.0.1:50539, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0032_r_000000_0_-1494942558_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360, duration: 47447000
2015-02-12 14:54:47,160 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:47,161 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:54:47,161 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54305, dest: /127.0.0.1:50549, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0032_r_000000_0_-1494942558_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360, duration: 48308000
2015-02-12 14:54:47,161 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,162 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54303, dest: /127.0.0.1:50543, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0032_r_000000_0_-1494942558_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360, duration: 48966000
2015-02-12 14:54:47,162 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,162 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,169 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0032_r_000000_0_-1494942558_1
2015-02-12 14:54:47,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:54:47,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:54:47,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/task_1423780884992_0032_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:54:47,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/_temporary/attempt_1423780884992_0032_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/task_1423780884992_0032_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:54:47,230 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:47,234 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000009
2015-02-12 14:54:47,234 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000009
2015-02-12 14:54:47,234 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:54:47,234 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000009
2015-02-12 14:54:47,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,252 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:54:47,276 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0032_01_000009 is : 143
2015-02-12 14:54:47,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:47,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:47,280 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:54:47,281 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000009
2015-02-12 14:54:47,282 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000009
2015-02-12 14:54:47,282 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:54:47,282 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000009 from application application_1423780884992_0032
2015-02-12 14:54:47,282 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:47,282 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000009
2015-02-12 14:54:47,282 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000009
2015-02-12 14:54:47,282 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:47,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/task_1423780884992_0032_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:54:47,283 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000009
2015-02-12 14:54:47,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:47,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary/1/task_1423780884992_0032_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary dst=null perm=null proto=rpc
2015-02-12 14:54:47,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,307 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,327 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,358 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54253, dest: /127.0.0.1:50543, bytes: 75483, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359, duration: 6508686000
2015-02-12 14:54:47,359 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:47,366 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54252, dest: /127.0.0.1:50549, bytes: 75483, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359, duration: 6512703000
2015-02-12 14:54:47,367 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,372 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17020
2015-02-12 14:54:47,383 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54251, dest: /127.0.0.1:50546, bytes: 75483, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359, duration: 6532085000
2015-02-12 14:54:47,389 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,394 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17020
2015-02-12 14:54:47,396 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742183_1359 size 75483
2015-02-12 14:54:47,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,406 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:54:47,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361 src: /127.0.0.1:54308 dest: /127.0.0.1:50539
2015-02-12 14:54:47,410 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361 src: /127.0.0.1:54309 dest: /127.0.0.1:50546
2015-02-12 14:54:47,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361 src: /127.0.0.1:54310 dest: /127.0.0.1:50543
2015-02-12 14:54:47,422 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54310, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361, duration: 6956000
2015-02-12 14:54:47,423 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:47,423 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54309, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361, duration: 6255000
2015-02-12 14:54:47,424 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,425 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54308, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361, duration: 8076000
2015-02-12 14:54:47,426 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,427 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,428 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,434 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary_tmp is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:47,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:54:47,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:47,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:54:47,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:47,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:54:47,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,471 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:54:47,474 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362 src: /127.0.0.1:54312 dest: /127.0.0.1:50543
2015-02-12 14:54:47,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362 src: /127.0.0.1:54313 dest: /127.0.0.1:50549
2015-02-12 14:54:47,478 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362 src: /127.0.0.1:54314 dest: /127.0.0.1:50539
2015-02-12 14:54:47,487 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54314, dest: /127.0.0.1:50539, bytes: 75483, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362, duration: 4369000
2015-02-12 14:54:47,487 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:47,488 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54313, dest: /127.0.0.1:50549, bytes: 75483, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362, duration: 4725000
2015-02-12 14:54:47,489 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,489 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,494 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54312, dest: /127.0.0.1:50543, bytes: 75483, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362, duration: 8843000
2015-02-12 14:54:47,495 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,496 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,497 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,500 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:47,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:54:47,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:47,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:54:47,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:54:47,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032/job_1423780884992_0032_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:54:47,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:47,522 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:54:47,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363 src: /127.0.0.1:54317 dest: /127.0.0.1:50546
2015-02-12 14:54:47,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363 src: /127.0.0.1:54318 dest: /127.0.0.1:50549
2015-02-12 14:54:47,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363 src: /127.0.0.1:54319 dest: /127.0.0.1:50539
2015-02-12 14:54:47,530 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54319, dest: /127.0.0.1:50539, bytes: 114542, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363, duration: 1816000
2015-02-12 14:54:47,531 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:47,532 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,532 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54318, dest: /127.0.0.1:50549, bytes: 114542, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363, duration: 2878000
2015-02-12 14:54:47,533 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,534 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,535 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54317, dest: /127.0.0.1:50546, bytes: 114542, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-827663106_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363, duration: 5238000
2015-02-12 14:54:47,535 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:47,536 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:47,537 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-827663106_1
2015-02-12 14:54:47,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:47,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:47,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:47,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:54:47,572 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0032_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:54:47,572 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:54:47,572 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0032 with final state: FINISHING
2015-02-12 14:54:47,572 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from RUNNING to FINAL_SAVING
2015-02-12 14:54:47,573 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0032
2015-02-12 14:54:47,573 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:54:47,573 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from FINAL_SAVING to FINISHING
2015-02-12 14:54:48,238 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:48,238 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:54:48,239 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000009
2015-02-12 14:54:48,239 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:48,239 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000009 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:48,579 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0032 unregistered successfully.
2015-02-12 14:54:48,583 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742177_1353 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:54:48,583 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742178_1354 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:54:48,583 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742179_1355 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:54:48,583 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742180_1356 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:54:48,584 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742182_1358 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:54:48,584 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742183_1359 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:54:48,584 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742181_1357 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:54:48,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0032 dst=null perm=null proto=rpc
2015-02-12 14:54:48,638 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742173_1349 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:54:48,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/9496597683_upper_EE196A4B3BA24204BF298D1ADE11F3E2 dst=null perm=null proto=rpc
2015-02-12 14:54:48,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,641 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary
2015-02-12 14:54:48,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/_temporary dst=null perm=null proto=rpc
2015-02-12 14:54:48,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,666 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:48,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:48,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,708 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:48,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:48,710 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch
2015-02-12 14:54:48,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch dst=null perm=null proto=rpc
2015-02-12 14:54:48,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:48,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupfilteredbranch/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:54:48,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,738 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:54:48,738 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:54:48,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:54:48,752 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:54:48,752 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:54:48,752 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:54:48,752 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup"]
2015-02-12 14:54:48,752 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:54:48,752 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:54:48,753 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:54:48,754 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ldedpipesplatform/cogroup
2015-02-12 14:54:48,767 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:54:48,780 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:54:48,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:54:48,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:54:48,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:54:48,788 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 33
2015-02-12 14:54:48,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033 dst=null perm=null proto=rpc
2015-02-12 14:54:48,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:54:48,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:54:48,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,795 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:54:48,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 src: /127.0.0.1:54324 dest: /127.0.0.1:50549
2015-02-12 14:54:48,800 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 src: /127.0.0.1:54325 dest: /127.0.0.1:50539
2015-02-12 14:54:48,802 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 src: /127.0.0.1:54326 dest: /127.0.0.1:50543
2015-02-12 14:54:48,807 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54326, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364, duration: 2406000
2015-02-12 14:54:48,807 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:48,808 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:54:48,808 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54325, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364, duration: 3632000
2015-02-12 14:54:48,809 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,809 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,810 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54324, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364, duration: 5224000
2015-02-12 14:54:48,810 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,812 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,815 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:48,816 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar
2015-02-12 14:54:48,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:54:48,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:54:48,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:54:48,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:54:48,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:54:48,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,825 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:48,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,828 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:48,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,830 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:48,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,834 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:54:48,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:54:48,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,840 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split
2015-02-12 14:54:48,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:48,843 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:54:48,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365 src: /127.0.0.1:54327 dest: /127.0.0.1:50543
2015-02-12 14:54:48,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365 src: /127.0.0.1:54328 dest: /127.0.0.1:50549
2015-02-12 14:54:48,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365 src: /127.0.0.1:54329 dest: /127.0.0.1:50539
2015-02-12 14:54:48,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365 src: /127.0.0.1:54330 dest: /127.0.0.1:50546
2015-02-12 14:54:48,857 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54330, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, duration: 2493000
2015-02-12 14:54:48,857 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:48,858 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54329, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, duration: 2894000
2015-02-12 14:54:48,858 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,859 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,860 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54328, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, duration: 4362000
2015-02-12 14:54:48,860 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,861 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54327, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, duration: 6398000
2015-02-12 14:54:48,862 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,862 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,864 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,865 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,866 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:48,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,871 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:54:48,873 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366 src: /127.0.0.1:54331 dest: /127.0.0.1:50539
2015-02-12 14:54:48,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366 src: /127.0.0.1:54332 dest: /127.0.0.1:50543
2015-02-12 14:54:48,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366 src: /127.0.0.1:54333 dest: /127.0.0.1:50546
2015-02-12 14:54:48,878 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54333, dest: /127.0.0.1:50546, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366, duration: 1132000
2015-02-12 14:54:48,878 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:48,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:54:48,879 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54332, dest: /127.0.0.1:50543, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366, duration: 1751000
2015-02-12 14:54:48,879 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,880 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54331, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366, duration: 2724000
2015-02-12 14:54:48,880 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,882 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:48,883 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:48,883 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:54:48,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:54:48,894 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:54:48,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367 src: /127.0.0.1:54334 dest: /127.0.0.1:50549
2015-02-12 14:54:48,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367 src: /127.0.0.1:54335 dest: /127.0.0.1:50543
2015-02-12 14:54:48,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367 src: /127.0.0.1:54336 dest: /127.0.0.1:50546
2015-02-12 14:54:48,905 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54336, dest: /127.0.0.1:50546, bytes: 97390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367, duration: 1892000
2015-02-12 14:54:48,906 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:48,907 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:54:48,907 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54335, dest: /127.0.0.1:50543, bytes: 97390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367, duration: 3749000
2015-02-12 14:54:48,908 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,908 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:54:48,909 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54334, dest: /127.0.0.1:50549, bytes: 97390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367, duration: 5466000
2015-02-12 14:54:48,909 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:48,910 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:54:48,911 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:54:48,912 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0033
2015-02-12 14:54:48,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033 dst=null perm=null proto=rpc
2015-02-12 14:54:48,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:48,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:48,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:48,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:48,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:48,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:48,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:48,926 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 33 submitted by user soberoi
2015-02-12 14:54:48,926 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0033
2015-02-12 14:54:48,926 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0033
2015-02-12 14:54:48,926 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from NEW to NEW_SAVING
2015-02-12 14:54:48,926 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0033
2015-02-12 14:54:48,927 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:54:48,927 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0033 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:54:48,927 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from SUBMITTED to ACCEPTED
2015-02-12 14:54:48,927 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0033_000001
2015-02-12 14:54:48,927 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from NEW to SUBMITTED
2015-02-12 14:54:48,927 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0033_000001 to scheduler from user: soberoi
2015-02-12 14:54:48,928 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:54:48,929 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0033
2015-02-12 14:54:48,931 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0033/
2015-02-12 14:54:48,932 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0033
2015-02-12 14:54:48,932 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0033/
2015-02-12 14:54:49,243 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:49,245 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:49,245 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000001
2015-02-12 14:54:49,245 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:54:49,245 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0033_01_000001
2015-02-12 14:54:49,246 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:49,246 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0033_000001
2015-02-12 14:54:49,246 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0033 AttemptId: appattempt_1423780884992_0033_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0033_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:54:49,246 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:54:49,246 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:54:49,246 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0033_000001
2015-02-12 14:54:49,247 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0033_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0033_000001
2015-02-12 14:54:49,247 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0033_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:54:49,248 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0033_000001
2015-02-12 14:54:49,248 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0033_000001
2015-02-12 14:54:49,250 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:49,252 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000001 by user soberoi
2015-02-12 14:54:49,252 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0033
2015-02-12 14:54:49,252 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000001
2015-02-12 14:54:49,252 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from NEW to INITING
2015-02-12 14:54:49,252 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000001 to application application_1423780884992_0033
2015-02-12 14:54:49,253 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from INITING to RUNNING
2015-02-12 14:54:49,253 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0033_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0033_000001
2015-02-12 14:54:49,253 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:54:49,253 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:54:49,253 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:49,253 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:49,254 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:54:49,254 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:54:49,254 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:49,254 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0033_01_000001
2015-02-12 14:54:49,264 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0033_01_000001.tokens. Credentials list:
2015-02-12 14:54:49,334 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742188_1364 to datanode(s) 127.0.0.1:50546
2015-02-12 14:54:49,334 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742177_1353, blk_1073742178_1354, blk_1073742179_1355, blk_1073742182_1358, blk_1073742183_1359, blk_1073742173_1349]
2015-02-12 14:54:49,334 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742177_1353, blk_1073742178_1354, blk_1073742179_1355, blk_1073742180_1356, blk_1073742181_1357, blk_1073742182_1358, blk_1073742183_1359]
2015-02-12 14:54:49,380 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:49,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0033_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000001.tokens
2015-02-12 14:54:49,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:54:49,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:49,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:49,793 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:49,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:49,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:49,893 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0033/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:49,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:49,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:54:49,982 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0033/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:50,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:50,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:50,087 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0033/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:50,088 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:50,143 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:50,143 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:50,247 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:50,247 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:50,332 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000001/default_container_executor.sh]
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177 for deletion
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178 for deletion
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742179 for deletion
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742180 for deletion
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742181 for deletion
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742182 for deletion
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178
2015-02-12 14:54:50,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742179
2015-02-12 14:54:50,469 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742183 for deletion
2015-02-12 14:54:50,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742180
2015-02-12 14:54:50,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742181
2015-02-12 14:54:50,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742182
2015-02-12 14:54:50,470 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742183
2015-02-12 14:54:50,744 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 to 127.0.0.1:50546
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177 for deletion
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178 for deletion
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742179 for deletion
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742182 for deletion
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742183 for deletion
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742173 for deletion
2015-02-12 14:54:50,746 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742179
2015-02-12 14:54:50,745 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177
2015-02-12 14:54:50,746 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:54:50,746 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178
2015-02-12 14:54:50,746 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742182
2015-02-12 14:54:50,746 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 src: /127.0.0.1:54346 dest: /127.0.0.1:50546
2015-02-12 14:54:50,746 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742173
2015-02-12 14:54:50,746 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742183
2015-02-12 14:54:50,748 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364 src: /127.0.0.1:54346 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:54:50,749 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742188_1364 size 254067
2015-02-12 14:54:51,251 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:52,254 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:52,340 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742177_1353, blk_1073742178_1354, blk_1073742179_1355, blk_1073742180_1356, blk_1073742181_1357, blk_1073742182_1358, blk_1073742173_1349]
2015-02-12 14:54:52,340 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742177_1353, blk_1073742178_1354, blk_1073742180_1356, blk_1073742181_1357, blk_1073742183_1359, blk_1073742173_1349]
2015-02-12 14:54:52,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:54:52,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:54:52,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:54:52,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:54:52,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033 dst=null perm=null proto=rpc
2015-02-12 14:54:52,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:54:52,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:54:52,669 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363
2015-02-12 14:54:52,669 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362
2015-02-12 14:54:52,670 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360
2015-02-12 14:54:52,670 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361
2015-02-12 14:54:52,889 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360
2015-02-12 14:54:52,890 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362
2015-02-12 14:54:52,890 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361
2015-02-12 14:54:52,890 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742183_1359
2015-02-12 14:54:52,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:52,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:54:53,108 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177 for deletion
2015-02-12 14:54:53,108 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178 for deletion
2015-02-12 14:54:53,108 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742180 for deletion
2015-02-12 14:54:53,108 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742181 for deletion
2015-02-12 14:54:53,108 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177
2015-02-12 14:54:53,109 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178
2015-02-12 14:54:53,109 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742180
2015-02-12 14:54:53,108 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742183 for deletion
2015-02-12 14:54:53,109 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742173 for deletion
2015-02-12 14:54:53,109 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742181
2015-02-12 14:54:53,109 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742173
2015-02-12 14:54:53,110 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742183
2015-02-12 14:54:53,157 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177 for deletion
2015-02-12 14:54:53,157 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178 for deletion
2015-02-12 14:54:53,157 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742179 for deletion
2015-02-12 14:54:53,157 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742180 for deletion
2015-02-12 14:54:53,157 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742181 for deletion
2015-02-12 14:54:53,157 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742182 for deletion
2015-02-12 14:54:53,158 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742173 for deletion
2015-02-12 14:54:53,158 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742177
2015-02-12 14:54:53,159 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742179
2015-02-12 14:54:53,159 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742181
2015-02-12 14:54:53,159 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742178
2015-02-12 14:54:53,159 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742180
2015-02-12 14:54:53,160 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742182
2015-02-12 14:54:53,160 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742173
2015-02-12 14:54:53,257 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:53,536 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742184_1360
2015-02-12 14:54:53,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363
2015-02-12 14:54:53,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742186_1362
2015-02-12 14:54:53,644 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0032_01_000001 succeeded
2015-02-12 14:54:53,644 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:54:53,645 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0032_01_000001
2015-02-12 14:54:53,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000001
2015-02-12 14:54:53,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000001
2015-02-12 14:54:53,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000001
2015-02-12 14:54:53,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0032/container_1423780884992_0032_01_000001
2015-02-12 14:54:53,664 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000001
2015-02-12 14:54:53,665 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0032_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:54:53,665 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0032_01_000001 from application application_1423780884992_0032
2015-02-12 14:54:53,665 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:53,665 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0032
2015-02-12 14:54:53,712 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742187_1363
2015-02-12 14:54:53,713 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742185_1361
2015-02-12 14:54:53,856 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0032_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:54:53,856 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0032_000001
2015-02-12 14:54:53,856 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0032_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:54:53,856 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000001
2015-02-12 14:54:53,856 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0032_000001
2015-02-12 14:54:53,856 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0032_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:54:53,856 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0032_000001 State change from FINISHING to FINISHED
2015-02-12 14:54:53,857 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0032 State change from FINISHING to FINISHED
2015-02-12 14:54:53,856 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0032_000001 released container container_1423780884992_0032_01_000001 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:54:53,857 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0032
2015-02-12 14:54:53,857 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0032,name=[672128F228ED4C28AA8F3FCB19B52DB7/4F4791B136CB464D8711C69CE1B9C27E] lower*upper/(1/2) ...orm/cogroupfilteredbranch,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0032/jobhistory/job/job_1423780884992_0032,appMasterHost=10.1.1.67,startTime=1423781659654,finishTime=1423781687572,finalStatus=SUCCEEDED
2015-02-12 14:54:53,857 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0032_000001 is done. finalState=FINISHED
2015-02-12 14:54:53,857 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0032 requests cleared
2015-02-12 14:54:53,857 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0032_000001
2015-02-12 14:54:53,860 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0032_000001 (auth:SIMPLE)
2015-02-12 14:54:53,861 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0032_01_000001
2015-02-12 14:54:53,862 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0032 CONTAINERID=container_1423780884992_0032_01_000001
2015-02-12 14:54:53,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0032_01_000001]
2015-02-12 14:54:53,862 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:53,862 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:53,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:53,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:53,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:53,863 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0032
2015-02-12 14:54:53,864 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:53,864 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0032, with delay of 10800 seconds
2015-02-12 14:54:53,864 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,117 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:54,119 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0033_000001
2015-02-12 14:54:54,119 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0033 APPATTEMPTID=appattempt_1423780884992_0033_000001
2015-02-12 14:54:54,119 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:54:54,119 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from ACCEPTED to RUNNING
2015-02-12 14:54:54,180 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 2933 Total time for transactions(ms): 240 Number of transactions batched in Syncs: 9 Number of syncs: 2039 SyncTimes(ms): 688 491
2015-02-12 14:54:54,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:54,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:54:54,258 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:54,258 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:54,258 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,259 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,259 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,259 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0032
2015-02-12 14:54:54,259 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:54,260 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0032, with delay of 10800 seconds
2015-02-12 14:54:54,259 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:54,438 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:54,439 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,439 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0032
2015-02-12 14:54:54,439 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:54,439 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0032, with delay of 10800 seconds
2015-02-12 14:54:54,440 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,441 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,441 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,517 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:54:54,517 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0032
2015-02-12 14:54:54,518 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0032
2015-02-12 14:54:54,520 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:54:54,520 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0032, with delay of 10800 seconds
2015-02-12 14:54:54,637 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:54:54,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368 src: /127.0.0.1:54356 dest: /127.0.0.1:50546
2015-02-12 14:54:54,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368 src: /127.0.0.1:54357 dest: /127.0.0.1:50549
2015-02-12 14:54:54,697 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368 src: /127.0.0.1:54358 dest: /127.0.0.1:50543
2015-02-12 14:54:54,737 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54358, dest: /127.0.0.1:50543, bytes: 114129, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368, duration: 37543000
2015-02-12 14:54:54,737 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:54,737 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:54,738 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54357, dest: /127.0.0.1:50549, bytes: 114129, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368, duration: 38501000
2015-02-12 14:54:54,738 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:54,739 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54356, dest: /127.0.0.1:50546, bytes: 114129, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368, duration: 39535000
2015-02-12 14:54:54,739 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:54,739 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:54,740 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:54,746 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:54:54,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:54:54,783 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:54:54,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369 src: /127.0.0.1:54359 dest: /127.0.0.1:50546
2015-02-12 14:54:54,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369 src: /127.0.0.1:54360 dest: /127.0.0.1:50539
2015-02-12 14:54:54,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369 src: /127.0.0.1:54361 dest: /127.0.0.1:50549
2015-02-12 14:54:54,793 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54361, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369, duration: 1442000
2015-02-12 14:54:54,793 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:54:54,794 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:54,794 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54360, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369, duration: 2081000
2015-02-12 14:54:54,794 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:54,794 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:54,795 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54359, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369, duration: 3214000
2015-02-12 14:54:54,795 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:54:54,796 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:54:54,800 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033.summary is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:54:55,263 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:54:55,263 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:55,263 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000002
2015-02-12 14:54:55,263 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:54:55,439 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:55,440 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000003
2015-02-12 14:54:55,440 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:55,521 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:55,523 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000004
2015-02-12 14:54:55,523 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:55,871 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:55,871 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000005
2015-02-12 14:54:55,871 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:54:56,168 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0033_01_000002
2015-02-12 14:54:56,169 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:56,169 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0033_01_000003
2015-02-12 14:54:56,170 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:56,170 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0033_01_000004
2015-02-12 14:54:56,170 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:56,171 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0033_01_000005
2015-02-12 14:54:56,171 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:56,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:56,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:56,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:54:56,268 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:56,268 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000006
2015-02-12 14:54:56,268 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:54:56,325 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:56,326 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:56,327 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:56,328 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:56,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000005 by user soberoi
2015-02-12 14:54:56,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000004 by user soberoi
2015-02-12 14:54:56,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0033
2015-02-12 14:54:56,332 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000005
2015-02-12 14:54:56,332 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from NEW to INITING
2015-02-12 14:54:56,332 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000005 to application application_1423780884992_0033
2015-02-12 14:54:56,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0033
2015-02-12 14:54:56,333 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000004
2015-02-12 14:54:56,333 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from INITING to RUNNING
2015-02-12 14:54:56,334 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:54:56,334 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,334 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,334 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:56,334 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:54:56,335 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:56,335 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:56,335 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0033_01_000005
2015-02-12 14:54:56,335 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from NEW to INITING
2015-02-12 14:54:56,336 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000004 to application application_1423780884992_0033
2015-02-12 14:54:56,338 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from INITING to RUNNING
2015-02-12 14:54:56,339 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:54:56,339 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,339 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,339 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:56,339 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:54:56,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:56,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:56,340 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0033_01_000004
2015-02-12 14:54:56,332 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000003 by user soberoi
2015-02-12 14:54:56,341 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0033
2015-02-12 14:54:56,342 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000003
2015-02-12 14:54:56,343 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from NEW to INITING
2015-02-12 14:54:56,343 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000003 to application application_1423780884992_0033
2015-02-12 14:54:56,343 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from INITING to RUNNING
2015-02-12 14:54:56,343 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:54:56,343 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,344 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,344 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:56,344 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:54:56,345 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:54:56,346 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:54:56,347 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0033_01_000003
2015-02-12 14:54:56,362 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000002 by user soberoi
2015-02-12 14:54:56,362 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000002
2015-02-12 14:54:56,362 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000002 to application application_1423780884992_0033
2015-02-12 14:54:56,363 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:54:56,363 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,363 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:54:56,363 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:56,363 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:54:56,364 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:56,385 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0033_01_000005.tokens. Credentials list:
2015-02-12 14:54:56,387 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0033_01_000004.tokens. Credentials list:
2015-02-12 14:54:56,391 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0033_01_000003.tokens. Credentials list:
2015-02-12 14:54:56,432 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:56,432 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:56,445 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:56,446 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:56,446 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000007
2015-02-12 14:54:56,446 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:54:56,524 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:56,678 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:56,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:56,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:56,811 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000002/default_container_executor.sh]
2015-02-12 14:54:56,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:56,900 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423780884992_0033_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000005.tokens
2015-02-12 14:54:56,900 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:54:56,935 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0033_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000004.tokens
2015-02-12 14:54:56,936 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:54:56,937 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0033_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000003.tokens
2015-02-12 14:54:56,937 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:54:57,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:57,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:57,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:57,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:57,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:57,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar dst=null perm=null proto=rpc
2015-02-12 14:54:57,109 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0033/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:57,135 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0033/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:57,143 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0033/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:57,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:57,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:57,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:57,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:57,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:57,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml dst=null perm=null proto=rpc
2015-02-12 14:54:57,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:57,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:57,205 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:57,205 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:54:57,209 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000006 by user soberoi
2015-02-12 14:54:57,209 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000006
2015-02-12 14:54:57,210 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000006 to application application_1423780884992_0033
2015-02-12 14:54:57,210 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000007 by user soberoi
2015-02-12 14:54:57,210 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:54:57,210 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:57,210 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:54:57,210 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:57,210 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000007 to application application_1423780884992_0033
2015-02-12 14:54:57,210 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000007
2015-02-12 14:54:57,210 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:54:57,211 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:54:57,211 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:54:57,211 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:54:57,211 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:54:57,211 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:54:57,211 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:57,211 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0033_01_000007
2015-02-12 14:54:57,237 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0033_01_000007.tokens. Credentials list:
2015-02-12 14:54:57,244 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0033/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:57,244 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:57,265 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:57,265 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:57,265 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:57,269 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:57,269 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:57,269 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0033
2015-02-12 14:54:57,269 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000008 Container Transitioned from NEW to RESERVED
2015-02-12 14:54:57,269 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0033_01_000008 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@69fbf01f
2015-02-12 14:54:57,285 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:57,285 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:57,294 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0033/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:54:57,294 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:54:57,332 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:57,332 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:57,338 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:57,338 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:57,351 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:57,351 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:57,362 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:54:57,362 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:54:57,450 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:54:57,450 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:57,450 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000009
2015-02-12 14:54:57,450 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:54:57,529 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:54:57,529 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000010
2015-02-12 14:54:57,529 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:54:57,662 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000005/default_container_executor.sh]
2015-02-12 14:54:57,668 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000003/default_container_executor.sh]
2015-02-12 14:54:57,676 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364
2015-02-12 14:54:57,676 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366
2015-02-12 14:54:57,677 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365
2015-02-12 14:54:57,681 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000007/default_container_executor.sh]
2015-02-12 14:54:57,683 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000006/default_container_executor.sh]
2015-02-12 14:54:57,742 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000004/default_container_executor.sh]
2015-02-12 14:54:57,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367
2015-02-12 14:54:57,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366
2015-02-12 14:54:57,899 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365
2015-02-12 14:54:58,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364
2015-02-12 14:54:58,190 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:54:58,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:58,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:54:58,272 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0033_000001 on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096
2015-02-12 14:54:58,272 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0033 unreserved on node host: 10.1.1.67:50583 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:54:58,301 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:54:58,448 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423780884992_0033_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000007.tokens
2015-02-12 14:54:58,449 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:54:58,544 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367
2015-02-12 14:54:58,722 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742191_1367
2015-02-12 14:54:58,722 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365
2015-02-12 14:54:58,747 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364
2015-02-12 14:54:58,748 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742189_1365
2015-02-12 14:54:58,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742188_1364
2015-02-12 14:54:58,926 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742190_1366
2015-02-12 14:54:59,194 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:54:59,194 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:54:59,194 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000009
2015-02-12 14:54:59,194 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:54:59,194 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000009 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:54:59,195 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000010 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:54:59,195 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000010 in state: RELEASED event:RELEASED
2015-02-12 14:54:59,195 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000010
2015-02-12 14:54:59,195 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:54:59,195 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000010 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:54:59,453 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0033_01_000009
2015-02-12 14:54:59,533 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0033_01_000010
2015-02-12 14:55:02,681 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369
2015-02-12 14:55:03,105 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368
2015-02-12 14:55:03,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369
2015-02-12 14:55:03,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368
2015-02-12 14:55:03,935 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742192_1368
2015-02-12 14:55:03,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742193_1369
2015-02-12 14:55:08,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:08,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:08,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:08,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:08,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:08,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:08,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:08,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:08,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:09,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:09,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:09,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:09,606 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30002 milliseconds
2015-02-12 14:55:09,607 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:55:09,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:55:10,065 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:10,067 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000002
2015-02-12 14:55:10,067 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000002
2015-02-12 14:55:10,067 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:55:10,068 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000002
2015-02-12 14:55:10,089 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:55:10,093 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000002 is : 143
2015-02-12 14:55:10,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370 src: /127.0.0.1:54417 dest: /127.0.0.1:50543
2015-02-12 14:55:10,094 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370 src: /127.0.0.1:54418 dest: /127.0.0.1:50546
2015-02-12 14:55:10,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370 src: /127.0.0.1:54419 dest: /127.0.0.1:50539
2015-02-12 14:55:10,113 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist for DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:10,113 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:10,114 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000002
2015-02-12 14:55:10,114 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000002
2015-02-12 14:55:10,114 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000002
2015-02-12 14:55:10,114 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000002
2015-02-12 14:55:10,114 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:10,114 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000002 from application application_1423780884992_0033
2015-02-12 14:55:10,115 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:10,115 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:10,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000002
2015-02-12 14:55:10,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:55:10,207 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:10,208 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000007
2015-02-12 14:55:10,208 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000007
2015-02-12 14:55:10,209 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:55:10,209 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000007
2015-02-12 14:55:10,234 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000007 is : 143
2015-02-12 14:55:10,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:55:10,245 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:10,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000007
2015-02-12 14:55:10,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000007
2015-02-12 14:55:10,247 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000007
2015-02-12 14:55:10,247 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000007
2015-02-12 14:55:10,247 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000007
2015-02-12 14:55:10,247 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:10,247 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000007 from application application_1423780884992_0033
2015-02-12 14:55:10,247 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:10,247 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:10,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:55:10,369 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:10,371 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000003
2015-02-12 14:55:10,371 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000003
2015-02-12 14:55:10,371 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:55:10,372 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000003
2015-02-12 14:55:10,372 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:10,372 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:55:10,372 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000007
2015-02-12 14:55:10,372 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:55:10,373 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000007 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:55:10,394 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000003 is : 143
2015-02-12 14:55:10,420 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:10,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000003
2015-02-12 14:55:10,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000003
2015-02-12 14:55:10,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000003
2015-02-12 14:55:10,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000003
2015-02-12 14:55:10,425 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000003
2015-02-12 14:55:10,426 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:10,426 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000003 from application application_1423780884992_0033
2015-02-12 14:55:10,427 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:10,427 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:10,486 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:10,488 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000006
2015-02-12 14:55:10,489 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000006
2015-02-12 14:55:10,489 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:55:10,489 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000006
2015-02-12 14:55:10,489 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:10,489 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:55:10,489 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000002
2015-02-12 14:55:10,490 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:55:10,490 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000002 on node: host: 10.1.1.67:50583 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:55:10,508 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000006 is : 143
2015-02-12 14:55:10,518 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:10,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000006
2015-02-12 14:55:10,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000006
2015-02-12 14:55:10,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000006
2015-02-12 14:55:10,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000006
2015-02-12 14:55:10,520 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000006
2015-02-12 14:55:10,520 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:10,520 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000006 from application application_1423780884992_0033
2015-02-12 14:55:10,521 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:10,521 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:10,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:55:10,584 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:10,585 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000005
2015-02-12 14:55:10,586 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000005
2015-02-12 14:55:10,586 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:55:10,586 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000005
2015-02-12 14:55:10,607 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000005 is : 143
2015-02-12 14:55:10,616 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:10,616 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000005
2015-02-12 14:55:10,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000005
2015-02-12 14:55:10,617 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000005
2015-02-12 14:55:10,617 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:10,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000005
2015-02-12 14:55:10,617 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000005 from application application_1423780884992_0033
2015-02-12 14:55:10,617 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:10,617 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:10,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000005
2015-02-12 14:55:10,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:55:10,692 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:10,694 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000004
2015-02-12 14:55:10,694 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000004
2015-02-12 14:55:10,694 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:55:10,694 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000004
2015-02-12 14:55:10,713 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000004 is : 143
2015-02-12 14:55:10,725 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:10,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000004
2015-02-12 14:55:10,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000004
2015-02-12 14:55:10,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000004
2015-02-12 14:55:10,727 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000004
2015-02-12 14:55:10,727 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000004
2015-02-12 14:55:10,727 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:10,727 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000004 from application application_1423780884992_0033
2015-02-12 14:55:10,727 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:10,728 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:11,378 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:11,378 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:55:11,378 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000003
2015-02-12 14:55:11,378 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:11,379 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:11,379 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:11,379 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:11,379 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000011
2015-02-12 14:55:11,380 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0033_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:11,492 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:11,493 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:11,493 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:55:11,493 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000006
2015-02-12 14:55:11,493 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:55:11,493 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000006 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:55:11,591 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:11,592 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:55:11,592 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000005
2015-02-12 14:55:11,592 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:11,592 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:11,697 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:11,697 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:55:11,697 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000004
2015-02-12 14:55:11,697 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:11,698 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000004 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:12,257 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:12,272 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:12,275 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0033_01_000011 by user soberoi
2015-02-12 14:55:12,275 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000011
2015-02-12 14:55:12,275 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0033_01_000011 to application application_1423780884992_0033
2015-02-12 14:55:12,276 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000011 transitioned from NEW to LOCALIZING
2015-02-12 14:55:12,276 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0033
2015-02-12 14:55:12,276 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0033
2015-02-12 14:55:12,276 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:12,276 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0033
2015-02-12 14:55:12,277 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000011 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:12,316 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000011 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:12,316 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:12,380 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000007]
2015-02-12 14:55:12,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000011 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:12,381 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:12,381 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:12,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000011/default_container_executor.sh]
2015-02-12 14:55:12,497 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000002]
2015-02-12 14:55:12,497 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:12,497 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:12,595 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:12,702 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:13,263 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:55:13,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000003]
2015-02-12 14:55:13,386 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:13,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000006]
2015-02-12 14:55:13,500 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:13,600 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000005]
2015-02-12 14:55:13,600 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:13,707 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000004]
2015-02-12 14:55:13,707 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:15,012 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:15,015 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:15,024 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:15,026 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:15,042 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:15,044 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:16,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,581 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:55:16,648 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371 src: /127.0.0.1:54446 dest: /127.0.0.1:50546
2015-02-12 14:55:16,651 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371 src: /127.0.0.1:54447 dest: /127.0.0.1:50549
2015-02-12 14:55:16,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371 src: /127.0.0.1:54448 dest: /127.0.0.1:50539
2015-02-12 14:55:16,681 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54448, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0033_r_000000_0_-357011548_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371, duration: 24858000
2015-02-12 14:55:16,681 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:16,681 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:55:16,681 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54447, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0033_r_000000_0_-357011548_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371, duration: 25173000
2015-02-12 14:55:16,682 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,682 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:16,682 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54446, dest: /127.0.0.1:50546, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0033_r_000000_0_-357011548_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371, duration: 26031000
2015-02-12 14:55:16,683 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,684 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:16,689 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0033_r_000000_0_-357011548_1
2015-02-12 14:55:16,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:55:16,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:55:16,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/task_1423780884992_0033_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:55:16,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/_temporary/attempt_1423780884992_0033_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/task_1423780884992_0033_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:55:16,732 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:16,736 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000011
2015-02-12 14:55:16,736 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000011
2015-02-12 14:55:16,736 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000011 transitioned from RUNNING to KILLING
2015-02-12 14:55:16,736 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000011
2015-02-12 14:55:16,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,754 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,763 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0033_01_000011 is : 143
2015-02-12 14:55:16,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:55:16,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:16,770 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:16,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:16,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000011
2015-02-12 14:55:16,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000011
2015-02-12 14:55:16,771 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000011
2015-02-12 14:55:16,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000011
2015-02-12 14:55:16,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000011
2015-02-12 14:55:16,771 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:16,772 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000011 from application application_1423780884992_0033
2015-02-12 14:55:16,772 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:16,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/task_1423780884992_0033_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:55:16,772 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:16,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:16,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary/1/task_1423780884992_0033_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:55:16,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,796 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,803 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,823 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54419, dest: /127.0.0.1:50539, bytes: 75568, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370, duration: 6723645000
2015-02-12 14:55:16,823 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:16,825 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 17031
2015-02-12 14:55:16,825 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54418, dest: /127.0.0.1:50546, bytes: 75568, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370, duration: 6721461000
2015-02-12 14:55:16,825 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,831 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 17031
2015-02-12 14:55:16,832 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54417, dest: /127.0.0.1:50543, bytes: 75568, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370, duration: 6731904000
2015-02-12 14:55:16,832 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,841 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742194_1370 size 75568
2015-02-12 14:55:16,842 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,850 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:55:16,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372 src: /127.0.0.1:54450 dest: /127.0.0.1:50543
2015-02-12 14:55:16,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372 src: /127.0.0.1:54451 dest: /127.0.0.1:50549
2015-02-12 14:55:16,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372 src: /127.0.0.1:54452 dest: /127.0.0.1:50546
2015-02-12 14:55:16,863 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54452, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372, duration: 3660000
2015-02-12 14:55:16,864 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:16,865 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54451, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372, duration: 2021000
2015-02-12 14:55:16,865 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,866 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:55:16,866 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54450, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372, duration: 6345000
2015-02-12 14:55:16,866 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:16,869 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742196_1372 size 455
2015-02-12 14:55:16,869 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary_tmp is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:16,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:55:16,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:16,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:55:16,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:16,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:55:16,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,903 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:55:16,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373 src: /127.0.0.1:54454 dest: /127.0.0.1:50549
2015-02-12 14:55:16,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373 src: /127.0.0.1:54455 dest: /127.0.0.1:50539
2015-02-12 14:55:16,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373 src: /127.0.0.1:54456 dest: /127.0.0.1:50543
2015-02-12 14:55:16,916 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54456, dest: /127.0.0.1:50543, bytes: 75568, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373, duration: 1980000
2015-02-12 14:55:16,916 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:16,917 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54455, dest: /127.0.0.1:50539, bytes: 75568, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373, duration: 2585000
2015-02-12 14:55:16,917 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,917 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:55:16,918 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54454, dest: /127.0.0.1:50549, bytes: 75568, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373, duration: 3936000
2015-02-12 14:55:16,918 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,921 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,922 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742197_1373 size 75568
2015-02-12 14:55:16,922 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742197_1373 size 75568
2015-02-12 14:55:16,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:16,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:55:16,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:16,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:55:16,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:16,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033/job_1423780884992_0033_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:55:16,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:16,942 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:55:16,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374 src: /127.0.0.1:54458 dest: /127.0.0.1:50546
2015-02-12 14:55:16,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374 src: /127.0.0.1:54459 dest: /127.0.0.1:50543
2015-02-12 14:55:16,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374 src: /127.0.0.1:54460 dest: /127.0.0.1:50539
2015-02-12 14:55:16,956 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54460, dest: /127.0.0.1:50539, bytes: 114129, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374, duration: 2272000
2015-02-12 14:55:16,957 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:16,964 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54459, dest: /127.0.0.1:50543, bytes: 114129, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374, duration: 6128000
2015-02-12 14:55:16,965 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,967 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54458, dest: /127.0.0.1:50546, bytes: 114129, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-386781684_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374, duration: 12805000
2015-02-12 14:55:16,968 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:16,969 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:55:16,973 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:16,974 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742198_1374 size 114129
2015-02-12 14:55:16,974 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-386781684_1
2015-02-12 14:55:16,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:16,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:16,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:16,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:17,003 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0033_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:55:17,004 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:55:17,004 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0033 with final state: FINISHING
2015-02-12 14:55:17,004 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from RUNNING to FINAL_SAVING
2015-02-12 14:55:17,012 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0033
2015-02-12 14:55:17,012 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:55:17,012 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from FINAL_SAVING to FINISHING
2015-02-12 14:55:17,741 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000011 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:17,741 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000011 in state: COMPLETED event:FINISHED
2015-02-12 14:55:17,741 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000011
2015-02-12 14:55:17,741 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:17,741 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000011 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:18,012 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0033 unregistered successfully.
2015-02-12 14:55:18,015 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742188_1364 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:55:18,016 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742189_1365 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:55:18,016 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742190_1366 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:55:18,016 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742191_1367 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:55:18,016 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742193_1369 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:55:18,016 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742194_1370 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:55:18,016 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742192_1368 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:55:18,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0033 dst=null perm=null proto=rpc
2015-02-12 14:55:18,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,070 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary
2015-02-12 14:55:18,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:55:18,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,090 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:18,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:18,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,109 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:18,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:18,112 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroup
2015-02-12 14:55:18,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup dst=null perm=null proto=rpc
2015-02-12 14:55:18,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:18,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:18,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,141 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:55:18,141 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:55:18,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:18,157 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:55:18,157 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:55:18,158 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:55:18,158 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown"]
2015-02-12 14:55:18,158 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:55:18,158 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:55:18,158 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:55:18,160 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ldedpipesplatform/unknown
2015-02-12 14:55:18,174 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:55:18,186 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:55:18,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:18,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:55:18,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:55:18,192 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 34
2015-02-12 14:55:18,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034 dst=null perm=null proto=rpc
2015-02-12 14:55:18,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:55:18,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:55:18,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,202 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:55:18,205 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 src: /127.0.0.1:54465 dest: /127.0.0.1:50549
2015-02-12 14:55:18,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 src: /127.0.0.1:54466 dest: /127.0.0.1:50543
2015-02-12 14:55:18,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 src: /127.0.0.1:54467 dest: /127.0.0.1:50539
2015-02-12 14:55:18,218 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54467, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375, duration: 2773000
2015-02-12 14:55:18,218 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:18,218 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:55:18,219 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54466, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375, duration: 6463000
2015-02-12 14:55:18,220 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:55:18,221 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54465, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375, duration: 8029000
2015-02-12 14:55:18,221 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,223 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,225 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:18,226 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar
2015-02-12 14:55:18,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:55:18,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:55:18,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:55:18,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:55:18,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:55:18,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,239 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:18,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,241 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:18,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,244 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:18,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,248 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:18,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:18,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,255 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split
2015-02-12 14:55:18,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:18,258 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:55:18,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376 src: /127.0.0.1:54468 dest: /127.0.0.1:50543
2015-02-12 14:55:18,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376 src: /127.0.0.1:54469 dest: /127.0.0.1:50549
2015-02-12 14:55:18,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376 src: /127.0.0.1:54470 dest: /127.0.0.1:50546
2015-02-12 14:55:18,265 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376 src: /127.0.0.1:54471 dest: /127.0.0.1:50539
2015-02-12 14:55:18,271 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54471, dest: /127.0.0.1:50539, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, duration: 1530000
2015-02-12 14:55:18,271 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:18,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,272 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54470, dest: /127.0.0.1:50546, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, duration: 2073000
2015-02-12 14:55:18,272 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,273 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54469, dest: /127.0.0.1:50549, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, duration: 3216000
2015-02-12 14:55:18,273 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,274 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,274 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54468, dest: /127.0.0.1:50543, bytes: 2143, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, duration: 4493000
2015-02-12 14:55:18,274 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,276 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,278 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:18,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,283 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:55:18,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377 src: /127.0.0.1:54472 dest: /127.0.0.1:50546
2015-02-12 14:55:18,286 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377 src: /127.0.0.1:54473 dest: /127.0.0.1:50549
2015-02-12 14:55:18,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377 src: /127.0.0.1:54474 dest: /127.0.0.1:50539
2015-02-12 14:55:18,289 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54474, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377, duration: 1199000
2015-02-12 14:55:18,290 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:18,290 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54473, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377, duration: 1852000
2015-02-12 14:55:18,290 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,291 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,292 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54472, dest: /127.0.0.1:50546, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377, duration: 2943000
2015-02-12 14:55:18,293 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,295 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,296 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:18,296 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742201_1377 size 218
2015-02-12 14:55:18,297 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:55:18,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:18,305 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:55:18,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378 src: /127.0.0.1:54475 dest: /127.0.0.1:50549
2015-02-12 14:55:18,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378 src: /127.0.0.1:54476 dest: /127.0.0.1:50543
2015-02-12 14:55:18,311 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378 src: /127.0.0.1:54477 dest: /127.0.0.1:50539
2015-02-12 14:55:18,316 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54477, dest: /127.0.0.1:50539, bytes: 97125, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378, duration: 1694000
2015-02-12 14:55:18,316 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:18,317 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:55:18,317 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54476, dest: /127.0.0.1:50543, bytes: 97125, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378, duration: 2153000
2015-02-12 14:55:18,317 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,318 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,318 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54475, dest: /127.0.0.1:50549, bytes: 97125, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378, duration: 3352000
2015-02-12 14:55:18,319 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:18,326 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:18,327 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:18,328 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0034
2015-02-12 14:55:18,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034 dst=null perm=null proto=rpc
2015-02-12 14:55:18,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:18,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:18,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:18,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:18,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:18,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:18,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,357 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 34 submitted by user soberoi
2015-02-12 14:55:18,357 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0034
2015-02-12 14:55:18,357 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from NEW to NEW_SAVING
2015-02-12 14:55:18,357 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0034
2015-02-12 14:55:18,357 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0034
2015-02-12 14:55:18,358 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:55:18,358 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0034 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:55:18,359 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from SUBMITTED to ACCEPTED
2015-02-12 14:55:18,359 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0034_000001
2015-02-12 14:55:18,359 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from NEW to SUBMITTED
2015-02-12 14:55:18,360 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0034_000001 to scheduler from user: soberoi
2015-02-12 14:55:18,361 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0034
2015-02-12 14:55:18,361 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:55:18,365 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0034/
2015-02-12 14:55:18,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0034
2015-02-12 14:55:18,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0034/
2015-02-12 14:55:18,514 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:18,514 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000001
2015-02-12 14:55:18,515 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:55:18,515 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0034_01_000001
2015-02-12 14:55:18,515 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:18,515 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0034_000001
2015-02-12 14:55:18,516 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0034 AttemptId: appattempt_1423780884992_0034_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0034_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ]
2015-02-12 14:55:18,516 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:55:18,516 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:55:18,516 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0034_000001
2015-02-12 14:55:18,517 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0034_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0034_000001
2015-02-12 14:55:18,518 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0034_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:55:18,518 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0034_000001
2015-02-12 14:55:18,518 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0034_000001
2015-02-12 14:55:18,520 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:18,522 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000001 by user soberoi
2015-02-12 14:55:18,523 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0034
2015-02-12 14:55:18,523 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000001
2015-02-12 14:55:18,523 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from NEW to INITING
2015-02-12 14:55:18,523 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000001 to application application_1423780884992_0034
2015-02-12 14:55:18,524 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from INITING to RUNNING
2015-02-12 14:55:18,524 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:55:18,524 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:18,524 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:18,525 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0034_01_000001, NodeId: 10.1.1.67:50583, NodeHttpAddress: 10.1.1.67:50586, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50583 }, ] for AM appattempt_1423780884992_0034_000001
2015-02-12 14:55:18,525 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:55:18,525 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:55:18,525 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:18,525 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0034_01_000001
2015-02-12 14:55:18,525 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:55:18,536 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0034_01_000001.tokens. Credentials list:
2015-02-12 14:55:18,648 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:18,744 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:18,749 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0034_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000001.tokens
2015-02-12 14:55:18,749 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:18,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:18,880 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:18,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:18,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:18,937 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0034/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:18,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:18,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:19,053 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0034/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:19,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:19,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:19,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0034/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:19,122 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:19,160 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:19,160 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:19,270 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000001/default_container_executor.sh]
2015-02-12 14:55:19,362 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742199_1375 to datanode(s) 127.0.0.1:50546
2015-02-12 14:55:19,362 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742192_1368, blk_1073742194_1370, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366, blk_1073742191_1367]
2015-02-12 14:55:19,362 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742192_1368, blk_1073742193_1369, blk_1073742194_1370, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366, blk_1073742191_1367]
2015-02-12 14:55:19,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:19,749 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:20,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742192 for deletion
2015-02-12 14:55:20,134 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742194_1370 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742194 for deletion
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188 for deletion
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189 for deletion
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742190 for deletion
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742192
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742190
2015-02-12 14:55:20,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742191_1367 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742191 for deletion
2015-02-12 14:55:20,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742194_1370 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742194
2015-02-12 14:55:20,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189
2015-02-12 14:55:20,137 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742191_1367 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742191
2015-02-12 14:55:20,183 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 to 127.0.0.1:50546
2015-02-12 14:55:20,185 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 src: /127.0.0.1:54482 dest: /127.0.0.1:50546
2015-02-12 14:55:20,185 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:55:20,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375 src: /127.0.0.1:54482 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:55:20,187 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742199_1375 size 254067
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742192 for deletion
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742193_1369 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742193 for deletion
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742194_1370 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742194 for deletion
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188 for deletion
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742192
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189 for deletion
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742190 for deletion
2015-02-12 14:55:20,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742191_1367 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742191 for deletion
2015-02-12 14:55:20,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742194_1370 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742194
2015-02-12 14:55:20,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742193_1369 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742193
2015-02-12 14:55:20,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189
2015-02-12 14:55:20,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188
2015-02-12 14:55:20,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742191_1367 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742191
2015-02-12 14:55:20,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742190
2015-02-12 14:55:20,751 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:21,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:55:21,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:55:21,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:55:21,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:55:21,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034 dst=null perm=null proto=rpc
2015-02-12 14:55:21,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:55:21,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:55:21,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:21,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:21,753 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:22,365 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742193_1369, blk_1073742194_1370, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366]
2015-02-12 14:55:22,366 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742192_1368, blk_1073742193_1369, blk_1073742188_1364, blk_1073742189_1365, blk_1073742191_1367]
2015-02-12 14:55:22,685 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:22,687 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0034_000001
2015-02-12 14:55:22,687 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0034 APPATTEMPTID=appattempt_1423780884992_0034_000001
2015-02-12 14:55:22,688 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:55:22,688 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from ACCEPTED to RUNNING
2015-02-12 14:55:22,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371
2015-02-12 14:55:22,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373
2015-02-12 14:55:22,701 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374
2015-02-12 14:55:22,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:22,755 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:22,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:55:22,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:22,900 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742194_1370
2015-02-12 14:55:23,066 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0033_01_000001 succeeded
2015-02-12 14:55:23,066 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:55:23,066 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0033_01_000001
2015-02-12 14:55:23,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000001
2015-02-12 14:55:23,107 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000001
2015-02-12 14:55:23,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000001
2015-02-12 14:55:23,107 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0033_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:55:23,108 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000001
2015-02-12 14:55:23,108 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033/container_1423780884992_0033_01_000001
2015-02-12 14:55:23,111 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0033_01_000001 from application application_1423780884992_0033
2015-02-12 14:55:23,112 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:23,112 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0033
2015-02-12 14:55:23,126 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374
2015-02-12 14:55:23,127 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373
2015-02-12 14:55:23,127 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372
2015-02-12 14:55:23,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742193_1369 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742193 for deletion
2015-02-12 14:55:23,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742194_1370 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742194 for deletion
2015-02-12 14:55:23,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188 for deletion
2015-02-12 14:55:23,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189 for deletion
2015-02-12 14:55:23,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742193_1369 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742193
2015-02-12 14:55:23,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742194_1370 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742194
2015-02-12 14:55:23,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189
2015-02-12 14:55:23,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742190 for deletion
2015-02-12 14:55:23,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188
2015-02-12 14:55:23,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742190
2015-02-12 14:55:23,345 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:55:23,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379 src: /127.0.0.1:54491 dest: /127.0.0.1:50543
2015-02-12 14:55:23,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379 src: /127.0.0.1:54492 dest: /127.0.0.1:50549
2015-02-12 14:55:23,406 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379 src: /127.0.0.1:54493 dest: /127.0.0.1:50546
2015-02-12 14:55:23,452 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54493, dest: /127.0.0.1:50546, bytes: 113816, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379, duration: 44248000
2015-02-12 14:55:23,453 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:23,453 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:55:23,453 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54492, dest: /127.0.0.1:50549, bytes: 113816, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379, duration: 45017000
2015-02-12 14:55:23,453 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:23,454 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54491, dest: /127.0.0.1:50543, bytes: 113816, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379, duration: 46136000
2015-02-12 14:55:23,454 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:23,456 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:23,456 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:23,461 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:23,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:23,506 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:55:23,508 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380 src: /127.0.0.1:54494 dest: /127.0.0.1:50546
2015-02-12 14:55:23,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380 src: /127.0.0.1:54495 dest: /127.0.0.1:50539
2015-02-12 14:55:23,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380 src: /127.0.0.1:54496 dest: /127.0.0.1:50549
2015-02-12 14:55:23,514 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54496, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380, duration: 1691000
2015-02-12 14:55:23,514 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:23,515 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:55:23,515 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54495, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380, duration: 1990000
2015-02-12 14:55:23,515 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:23,516 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54494, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380, duration: 3088000
2015-02-12 14:55:23,516 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:23,516 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:23,517 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:23,520 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034.summary is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:23,531 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0033_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:23,531 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0033_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:55:23,531 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0033_000001
2015-02-12 14:55:23,531 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0033_000001
2015-02-12 14:55:23,531 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000001
2015-02-12 14:55:23,531 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0033_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:55:23,532 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0033_000001 released container container_1423780884992_0033_01_000001 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:55:23,531 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0033_000001 State change from FINISHING to FINISHED
2015-02-12 14:55:23,532 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0033 State change from FINISHING to FINISHED
2015-02-12 14:55:23,532 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0033_000001 is done. finalState=FINISHED
2015-02-12 14:55:23,533 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0033
2015-02-12 14:55:23,533 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0033 requests cleared
2015-02-12 14:55:23,533 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0033,name=[DDC314AFB5B4439B8D2198701C0D078D/87ECC34C350D4421BF99264BA5956A32] lower*upper/(1/1) ...ldedpipesplatform/cogroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0033/jobhistory/job/job_1423780884992_0033,appMasterHost=10.1.1.67,startTime=1423781688926,finishTime=1423781717004,finalStatus=SUCCEEDED
2015-02-12 14:55:23,533 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0033_000001
2015-02-12 14:55:23,537 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0033_000001 (auth:SIMPLE)
2015-02-12 14:55:23,539 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0033_01_000001
2015-02-12 14:55:23,539 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0033 CONTAINERID=container_1423780884992_0033_01_000001
2015-02-12 14:55:23,539 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0033_01_000001]
2015-02-12 14:55:23,539 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:23,540 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:23,540 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,543 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,547 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,548 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0033
2015-02-12 14:55:23,548 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:23,549 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0033, with delay of 10800 seconds
2015-02-12 14:55:23,624 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:23,624 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,625 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0033
2015-02-12 14:55:23,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,625 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:23,626 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0033, with delay of 10800 seconds
2015-02-12 14:55:23,737 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:23,737 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:23,737 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000002
2015-02-12 14:55:23,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,738 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:23,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,738 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0033
2015-02-12 14:55:23,739 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:23,739 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0033, with delay of 10800 seconds
2015-02-12 14:55:23,759 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:23,759 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:23,760 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,760 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:23,760 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000003
2015-02-12 14:55:23,760 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,761 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0033
2015-02-12 14:55:23,761 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,761 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0033
2015-02-12 14:55:23,760 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:23,761 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:23,761 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0033, with delay of 10800 seconds
2015-02-12 14:55:23,769 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371
2015-02-12 14:55:23,770 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377
2015-02-12 14:55:23,770 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372
2015-02-12 14:55:23,776 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742192 for deletion
2015-02-12 14:55:23,777 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742193_1369 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742193 for deletion
2015-02-12 14:55:23,777 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188 for deletion
2015-02-12 14:55:23,777 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189 for deletion
2015-02-12 14:55:23,777 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742191_1367 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742191 for deletion
2015-02-12 14:55:23,777 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742192
2015-02-12 14:55:23,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742189
2015-02-12 14:55:23,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742193_1369 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742193
2015-02-12 14:55:23,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742188
2015-02-12 14:55:23,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742191_1367 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742191
2015-02-12 14:55:23,956 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742196_1372
2015-02-12 14:55:23,956 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377
2015-02-12 14:55:23,957 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742198_1374
2015-02-12 14:55:23,957 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376
2015-02-12 14:55:23,957 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742195_1371
2015-02-12 14:55:23,973 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375
2015-02-12 14:55:23,973 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376
2015-02-12 14:55:23,974 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742197_1373
2015-02-12 14:55:24,171 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378
2015-02-12 14:55:24,542 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:24,542 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000004
2015-02-12 14:55:24,542 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:55:24,628 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:24,628 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000005
2015-02-12 14:55:24,628 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:24,739 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:24,740 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000006
2015-02-12 14:55:24,740 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:55:24,749 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0034_01_000002
2015-02-12 14:55:24,749 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:24,749 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0034_01_000003
2015-02-12 14:55:24,749 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:24,749 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0034_01_000004
2015-02-12 14:55:24,750 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:24,750 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0034_01_000005
2015-02-12 14:55:24,750 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:24,751 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:24,764 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:24,765 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:24,765 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000007
2015-02-12 14:55:24,765 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:55:24,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:24,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:24,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:24,912 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:24,913 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:24,912 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:24,913 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:24,914 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:24,920 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000003 by user soberoi
2015-02-12 14:55:24,920 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0034
2015-02-12 14:55:24,921 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000003
2015-02-12 14:55:24,921 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from NEW to INITING
2015-02-12 14:55:24,921 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000003 to application application_1423780884992_0034
2015-02-12 14:55:24,922 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from INITING to RUNNING
2015-02-12 14:55:24,922 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:55:24,922 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,922 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,922 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:24,922 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:24,922 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:24,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:24,923 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0034_01_000003
2015-02-12 14:55:24,923 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000005 by user soberoi
2015-02-12 14:55:24,924 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0034
2015-02-12 14:55:24,926 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000005
2015-02-12 14:55:24,927 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000004 by user soberoi
2015-02-12 14:55:24,928 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000004
2015-02-12 14:55:24,931 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000002 by user soberoi
2015-02-12 14:55:24,931 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from NEW to INITING
2015-02-12 14:55:24,932 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000004 to application application_1423780884992_0034
2015-02-12 14:55:24,932 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:55:24,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,932 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:24,932 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:24,933 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:24,925 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000006 by user soberoi
2015-02-12 14:55:24,933 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000006
2015-02-12 14:55:24,932 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000005 to application application_1423780884992_0034
2015-02-12 14:55:24,935 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from INITING to RUNNING
2015-02-12 14:55:24,935 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:55:24,936 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,936 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,936 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:24,936 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:24,936 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:24,936 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:24,936 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0034_01_000005
2015-02-12 14:55:24,937 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000006 to application application_1423780884992_0034
2015-02-12 14:55:24,931 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0034
2015-02-12 14:55:24,941 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000002
2015-02-12 14:55:24,944 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from NEW to INITING
2015-02-12 14:55:24,944 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000002 to application application_1423780884992_0034
2015-02-12 14:55:24,945 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from INITING to RUNNING
2015-02-12 14:55:24,945 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:55:24,945 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:55:24,945 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,945 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,945 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:24,946 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:24,946 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:24,946 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:24,946 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,946 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:24,946 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:24,946 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:24,947 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0034_01_000006
2015-02-12 14:55:24,948 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0034_01_000002
2015-02-12 14:55:24,968 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0034_01_000003.tokens. Credentials list:
2015-02-12 14:55:24,973 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0034_01_000006.tokens. Credentials list:
2015-02-12 14:55:24,974 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0034_01_000005.tokens. Credentials list:
2015-02-12 14:55:24,974 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0034_01_000002.tokens. Credentials list:
2015-02-12 14:55:25,078 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:25,078 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:25,267 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:25,270 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:25,276 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:25,396 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000004/default_container_executor.sh]
2015-02-12 14:55:25,479 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0034_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000003.tokens
2015-02-12 14:55:25,479 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423780884992_0034_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000006.tokens
2015-02-12 14:55:25,480 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0034_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000005.tokens
2015-02-12 14:55:25,481 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:25,481 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:25,482 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:25,542 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:25,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:25,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:25,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:25,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:25,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:25,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:25,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:25,739 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0034/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:25,740 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:25,741 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:25,750 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0034/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:25,750 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:25,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:25,765 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:25,765 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:25,765 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000008
2015-02-12 14:55:25,765 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:55:25,771 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:25,774 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000007 by user soberoi
2015-02-12 14:55:25,774 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000007
2015-02-12 14:55:25,774 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000007 to application application_1423780884992_0034
2015-02-12 14:55:25,774 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:55:25,775 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:25,775 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:25,775 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:25,775 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:25,776 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0034_01_000007
2015-02-12 14:55:25,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:25,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:25,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:25,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:25,796 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0034_01_000007.tokens. Credentials list:
2015-02-12 14:55:25,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:25,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:25,873 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:25,873 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:25,873 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:25,889 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0034/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:25,889 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:25,896 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:25,896 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:25,897 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:25,963 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:25,963 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:25,981 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:25,981 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:25,986 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:25,986 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:25,990 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:25,990 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:26,023 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:26,023 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:26,294 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000002/default_container_executor.sh]
2015-02-12 14:55:26,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000007/default_container_executor.sh]
2015-02-12 14:55:26,307 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000003/default_container_executor.sh]
2015-02-12 14:55:26,309 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000006/default_container_executor.sh]
2015-02-12 14:55:26,321 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000005/default_container_executor.sh]
2015-02-12 14:55:26,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:26,767 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:55:26,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:26,908 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:26,929 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:27,051 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0034_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000007.tokens
2015-02-12 14:55:27,051 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:27,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0034_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000002.tokens
2015-02-12 14:55:27,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:27,771 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:55:27,772 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:55:27,772 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000008
2015-02-12 14:55:27,772 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:55:27,772 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000008 on node: host: 10.1.1.67:50575 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:55:27,905 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742201_1377
2015-02-12 14:55:27,905 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378
2015-02-12 14:55:27,906 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376
2015-02-12 14:55:27,907 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375
2015-02-12 14:55:28,132 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742202_1378
2015-02-12 14:55:28,132 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742200_1376
2015-02-12 14:55:28,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375
2015-02-12 14:55:28,772 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0034_01_000008
2015-02-12 14:55:28,963 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380
2015-02-12 14:55:28,964 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379
2015-02-12 14:55:28,965 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742199_1375
2015-02-12 14:55:29,178 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380
2015-02-12 14:55:29,179 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379
2015-02-12 14:55:32,911 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742204_1380
2015-02-12 14:55:33,140 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742203_1379
2015-02-12 14:55:37,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:37,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:37,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:37,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:37,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:37,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:37,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:37,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:37,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:37,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:55:37,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:37,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:55:38,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:55:38,312 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:38,314 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000004
2015-02-12 14:55:38,314 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000004
2015-02-12 14:55:38,314 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:55:38,314 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000004
2015-02-12 14:55:38,350 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000004 is : 143
2015-02-12 14:55:38,350 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:55:38,352 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381 src: /127.0.0.1:54540 dest: /127.0.0.1:50539
2015-02-12 14:55:38,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381 src: /127.0.0.1:54541 dest: /127.0.0.1:50549
2015-02-12 14:55:38,357 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381 src: /127.0.0.1:54542 dest: /127.0.0.1:50546
2015-02-12 14:55:38,369 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist for DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:38,371 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:38,372 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000004
2015-02-12 14:55:38,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000004
2015-02-12 14:55:38,374 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000004
2015-02-12 14:55:38,374 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000004
2015-02-12 14:55:38,376 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000004
2015-02-12 14:55:38,376 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:38,376 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000004 from application application_1423780884992_0034
2015-02-12 14:55:38,376 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:38,376 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:38,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:55:38,480 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:38,482 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000006
2015-02-12 14:55:38,482 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000006
2015-02-12 14:55:38,482 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:55:38,482 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000006
2015-02-12 14:55:38,502 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000006 is : 143
2015-02-12 14:55:38,511 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:38,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000006
2015-02-12 14:55:38,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000006
2015-02-12 14:55:38,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000006
2015-02-12 14:55:38,512 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000006
2015-02-12 14:55:38,513 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:38,513 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000006 from application application_1423780884992_0034
2015-02-12 14:55:38,513 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:38,513 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:38,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000006
2015-02-12 14:55:38,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:55:38,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:55:38,584 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:38,586 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000005
2015-02-12 14:55:38,587 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000005
2015-02-12 14:55:38,588 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:55:38,588 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000005
2015-02-12 14:55:38,616 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000005 is : 143
2015-02-12 14:55:38,626 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:38,626 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000005
2015-02-12 14:55:38,627 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000005
2015-02-12 14:55:38,627 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000005
2015-02-12 14:55:38,628 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000005
2015-02-12 14:55:38,629 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000005
2015-02-12 14:55:38,629 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:38,629 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000005 from application application_1423780884992_0034
2015-02-12 14:55:38,629 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:38,629 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:38,689 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:38,691 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000007
2015-02-12 14:55:38,691 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000007
2015-02-12 14:55:38,691 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:55:38,691 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000007
2015-02-12 14:55:38,709 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000007 is : 143
2015-02-12 14:55:38,717 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:38,718 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000007
2015-02-12 14:55:38,719 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000007
2015-02-12 14:55:38,719 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000007
2015-02-12 14:55:38,719 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000007
2015-02-12 14:55:38,719 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000007
2015-02-12 14:55:38,719 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:38,720 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000007 from application application_1423780884992_0034
2015-02-12 14:55:38,720 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:38,722 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:38,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:55:38,795 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:38,797 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000003
2015-02-12 14:55:38,797 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000003
2015-02-12 14:55:38,798 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:55:38,798 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000003
2015-02-12 14:55:38,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:38,799 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:55:38,799 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000007
2015-02-12 14:55:38,799 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:55:38,799 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000007 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:55:38,821 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000003 is : 143
2015-02-12 14:55:38,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:55:38,833 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:38,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000003
2015-02-12 14:55:38,835 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000003
2015-02-12 14:55:38,835 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000003
2015-02-12 14:55:38,835 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000003
2015-02-12 14:55:38,836 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000003
2015-02-12 14:55:38,838 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:38,838 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000003 from application application_1423780884992_0034
2015-02-12 14:55:38,838 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:38,838 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:38,886 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:38,889 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000002
2015-02-12 14:55:38,890 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000002
2015-02-12 14:55:38,891 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:38,891 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:55:38,891 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000006
2015-02-12 14:55:38,891 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:55:38,891 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:55:38,891 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:55:38,891 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000002
2015-02-12 14:55:38,913 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000002 is : 143
2015-02-12 14:55:38,930 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:38,931 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000002
2015-02-12 14:55:38,931 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000002
2015-02-12 14:55:38,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000002
2015-02-12 14:55:38,933 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000002
2015-02-12 14:55:38,934 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000002
2015-02-12 14:55:38,934 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:38,934 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000002 from application application_1423780884992_0034
2015-02-12 14:55:38,934 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:38,934 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:39,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:39,317 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:55:39,317 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000004
2015-02-12 14:55:39,318 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:55:39,318 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000004 on node: host: 10.1.1.67:50583 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:55:39,596 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:39,596 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:55:39,596 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000005
2015-02-12 14:55:39,596 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:39,596 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000005 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:39,611 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:55:39,612 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:55:39,802 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:39,802 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:55:39,802 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000003
2015-02-12 14:55:39,802 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:39,802 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:39,802 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:39,896 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:39,896 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:55:39,896 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000002
2015-02-12 14:55:39,896 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:39,896 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000002 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:39,897 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:39,897 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:39,898 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000009
2015-02-12 14:55:39,898 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0034_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:40,319 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:40,601 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:40,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000007]
2015-02-12 14:55:40,806 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:40,806 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:40,824 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:40,836 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:40,838 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0034_01_000009 by user soberoi
2015-02-12 14:55:40,838 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000009
2015-02-12 14:55:40,838 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0034_01_000009 to application application_1423780884992_0034
2015-02-12 14:55:40,838 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:55:40,838 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0034
2015-02-12 14:55:40,838 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0034
2015-02-12 14:55:40,839 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:40,839 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0034
2015-02-12 14:55:40,839 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:40,877 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:40,877 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:40,899 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000006]
2015-02-12 14:55:40,899 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:40,899 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:40,899 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:40,979 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000009/default_container_executor.sh]
2015-02-12 14:55:41,324 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000004]
2015-02-12 14:55:41,325 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:41,604 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000005]
2015-02-12 14:55:41,604 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:41,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000003]
2015-02-12 14:55:41,807 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:41,829 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:55:41,903 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000002]
2015-02-12 14:55:41,903 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:43,560 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:43,562 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:43,564 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:43,567 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:43,576 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:55:43,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:43,876 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:55:43,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382 src: /127.0.0.1:54557 dest: /127.0.0.1:50549
2015-02-12 14:55:43,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382 src: /127.0.0.1:54558 dest: /127.0.0.1:50539
2015-02-12 14:55:43,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382 src: /127.0.0.1:54559 dest: /127.0.0.1:50546
2015-02-12 14:55:44,022 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54559, dest: /127.0.0.1:50546, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0034_r_000000_0_-1149104861_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382, duration: 42726000
2015-02-12 14:55:44,022 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:44,023 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,023 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54558, dest: /127.0.0.1:50539, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0034_r_000000_0_-1149104861_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382, duration: 43788000
2015-02-12 14:55:44,023 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,024 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54557, dest: /127.0.0.1:50549, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0034_r_000000_0_-1149104861_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382, duration: 45064000
2015-02-12 14:55:44,024 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,026 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,034 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0034_r_000000_0_-1149104861_1
2015-02-12 14:55:44,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:55:44,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:55:44,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/task_1423780884992_0034_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:55:44,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1423780884992_0034_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/task_1423780884992_0034_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:55:44,087 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:44,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000009
2015-02-12 14:55:44,089 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000009
2015-02-12 14:55:44,089 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:55:44,089 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000009
2015-02-12 14:55:44,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,099 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:55:44,117 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0034_01_000009 is : 143
2015-02-12 14:55:44,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:44,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:44,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/task_1423780884992_0034_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:55:44,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:44,129 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:55:44,143 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000009
2015-02-12 14:55:44,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary/1/task_1423780884992_0034_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,144 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000009
2015-02-12 14:55:44,144 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:55:44,144 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000009 from application application_1423780884992_0034
2015-02-12 14:55:44,145 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:44,145 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:44,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000009
2015-02-12 14:55:44,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000009
2015-02-12 14:55:44,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000009
2015-02-12 14:55:44,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary dst=null perm=null proto=rpc
2015-02-12 14:55:44,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,157 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,167 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,193 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54542, dest: /127.0.0.1:50546, bytes: 75526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381, duration: 5832969000
2015-02-12 14:55:44,193 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:44,201 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54541, dest: /127.0.0.1:50549, bytes: 75526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381, duration: 5838786000
2015-02-12 14:55:44,201 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,202 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 17019
2015-02-12 14:55:44,205 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54540, dest: /127.0.0.1:50539, bytes: 75526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381, duration: 5844776000
2015-02-12 14:55:44,205 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742205_1381, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,206 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 17019
2015-02-12 14:55:44,209 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,209 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742205_1381 size 75526
2015-02-12 14:55:44,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,214 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:55:44,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383 src: /127.0.0.1:54561 dest: /127.0.0.1:50543
2015-02-12 14:55:44,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383 src: /127.0.0.1:54562 dest: /127.0.0.1:50539
2015-02-12 14:55:44,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383 src: /127.0.0.1:54563 dest: /127.0.0.1:50546
2015-02-12 14:55:44,224 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54563, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383, duration: 1395000
2015-02-12 14:55:44,224 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:44,224 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,225 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54562, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383, duration: 2100000
2015-02-12 14:55:44,226 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,228 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54561, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383, duration: 4538000
2015-02-12 14:55:44,228 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,230 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,232 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:44,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:55:44,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:44,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:55:44,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:44,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:55:44,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,270 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:55:44,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384 src: /127.0.0.1:54565 dest: /127.0.0.1:50546
2015-02-12 14:55:44,274 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384 src: /127.0.0.1:54566 dest: /127.0.0.1:50539
2015-02-12 14:55:44,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384 src: /127.0.0.1:54567 dest: /127.0.0.1:50549
2015-02-12 14:55:44,285 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54567, dest: /127.0.0.1:50549, bytes: 75526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384, duration: 6989000
2015-02-12 14:55:44,285 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:44,286 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:55:44,286 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54566, dest: /127.0.0.1:50539, bytes: 75526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384, duration: 8182000
2015-02-12 14:55:44,286 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:55:44,288 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54565, dest: /127.0.0.1:50546, bytes: 75526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384, duration: 9698000
2015-02-12 14:55:44,289 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,291 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:55:44,294 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:44,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:55:44,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:44,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:55:44,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:55:44,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034/job_1423780884992_0034_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:55:44,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:44,310 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:55:44,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385 src: /127.0.0.1:54569 dest: /127.0.0.1:50539
2015-02-12 14:55:44,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385 src: /127.0.0.1:54570 dest: /127.0.0.1:50549
2015-02-12 14:55:44,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385 src: /127.0.0.1:54571 dest: /127.0.0.1:50543
2015-02-12 14:55:44,322 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54571, dest: /127.0.0.1:50543, bytes: 113816, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385, duration: 2741000
2015-02-12 14:55:44,322 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:44,323 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:55:44,323 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54570, dest: /127.0.0.1:50549, bytes: 113816, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385, duration: 2867000
2015-02-12 14:55:44,323 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,324 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,324 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54569, dest: /127.0.0.1:50539, bytes: 113816, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1725469741_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385, duration: 4330000
2015-02-12 14:55:44,325 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:44,327 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:44,330 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1725469741_1
2015-02-12 14:55:44,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:44,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:44,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:44,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:55:44,352 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0034_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:55:44,352 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:55:44,352 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0034 with final state: FINISHING
2015-02-12 14:55:44,353 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from RUNNING to FINAL_SAVING
2015-02-12 14:55:44,353 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0034
2015-02-12 14:55:44,353 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:55:44,353 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from FINAL_SAVING to FINISHING
2015-02-12 14:55:45,094 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:45,095 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:55:45,095 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000009
2015-02-12 14:55:45,095 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:45,095 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000009 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:45,360 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0034 unregistered successfully.
2015-02-12 14:55:45,364 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742199_1375 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:55:45,364 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742200_1376 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:55:45,364 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742201_1377 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:55:45,365 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742202_1378 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:55:45,365 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742204_1380 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:55:45,365 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742205_1381 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:55:45,365 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742203_1379 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:55:45,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0034 dst=null perm=null proto=rpc
2015-02-12 14:55:45,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,424 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary
2015-02-12 14:55:45,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/_temporary dst=null perm=null proto=rpc
2015-02-12 14:55:45,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,444 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:45,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:45,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,457 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:45,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:45,460 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/unknown
2015-02-12 14:55:45,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown dst=null perm=null proto=rpc
2015-02-12 14:55:45,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:45,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/unknown/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:55:45,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,483 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:55:45,483 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:55:45,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull"]
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:55:45,499 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:55:45,501 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...orm/cogroupouterinnernull
2015-02-12 14:55:45,512 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:55:45,551 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:55:45,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:55:45,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:55:45,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:55:45,559 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 35
2015-02-12 14:55:45,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035 dst=null perm=null proto=rpc
2015-02-12 14:55:45,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:55:45,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:55:45,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,568 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:55:45,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 src: /127.0.0.1:54576 dest: /127.0.0.1:50546
2015-02-12 14:55:45,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 src: /127.0.0.1:54577 dest: /127.0.0.1:50539
2015-02-12 14:55:45,572 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 src: /127.0.0.1:54578 dest: /127.0.0.1:50549
2015-02-12 14:55:45,576 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54578, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386, duration: 3304000
2015-02-12 14:55:45,576 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:45,576 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:55:45,577 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54577, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386, duration: 3393000
2015-02-12 14:55:45,577 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,577 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:55:45,578 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54576, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386, duration: 3996000
2015-02-12 14:55:45,578 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,579 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:55:45,580 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:45,580 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar
2015-02-12 14:55:45,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:55:45,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:55:45,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:55:45,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:55:45,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:55:45,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,592 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:45,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,594 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:45,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,597 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:45,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,599 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:55:45,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:55:45,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,605 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split
2015-02-12 14:55:45,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:45,607 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:55:45,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387 src: /127.0.0.1:54579 dest: /127.0.0.1:50549
2015-02-12 14:55:45,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387 src: /127.0.0.1:54580 dest: /127.0.0.1:50543
2015-02-12 14:55:45,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387 src: /127.0.0.1:54581 dest: /127.0.0.1:50539
2015-02-12 14:55:45,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387 src: /127.0.0.1:54582 dest: /127.0.0.1:50546
2015-02-12 14:55:45,618 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54582, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, duration: 1683000
2015-02-12 14:55:45,619 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:45,620 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,620 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54581, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, duration: 2582000
2015-02-12 14:55:45,620 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,622 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54580, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, duration: 4730000
2015-02-12 14:55:45,623 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,623 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,624 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54579, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, duration: 7049000
2015-02-12 14:55:45,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,625 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,626 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,628 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:45,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,635 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:55:45,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388 src: /127.0.0.1:54583 dest: /127.0.0.1:50546
2015-02-12 14:55:45,638 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388 src: /127.0.0.1:54584 dest: /127.0.0.1:50539
2015-02-12 14:55:45,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388 src: /127.0.0.1:54585 dest: /127.0.0.1:50549
2015-02-12 14:55:45,643 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54585, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388, duration: 1191000
2015-02-12 14:55:45,643 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:45,644 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,644 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54584, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388, duration: 2603000
2015-02-12 14:55:45,645 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,645 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54583, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388, duration: 3537000
2015-02-12 14:55:45,646 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,646 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,647 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,649 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:45,649 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:55:45,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:55:45,661 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:55:45,662 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389 src: /127.0.0.1:54586 dest: /127.0.0.1:50546
2015-02-12 14:55:45,664 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389 src: /127.0.0.1:54587 dest: /127.0.0.1:50539
2015-02-12 14:55:45,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389 src: /127.0.0.1:54588 dest: /127.0.0.1:50549
2015-02-12 14:55:45,671 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54588, dest: /127.0.0.1:50549, bytes: 98361, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389, duration: 2999000
2015-02-12 14:55:45,671 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:45,671 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:55:45,672 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54587, dest: /127.0.0.1:50539, bytes: 98361, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389, duration: 3983000
2015-02-12 14:55:45,672 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,672 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,673 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54586, dest: /127.0.0.1:50546, bytes: 98361, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389, duration: 5101000
2015-02-12 14:55:45,673 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:45,674 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:45,677 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:55:45,677 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0035
2015-02-12 14:55:45,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035 dst=null perm=null proto=rpc
2015-02-12 14:55:45,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:45,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:45,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:45,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:45,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:45,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:45,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:45,696 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 35 submitted by user soberoi
2015-02-12 14:55:45,696 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0035
2015-02-12 14:55:45,696 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0035
2015-02-12 14:55:45,697 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0035
2015-02-12 14:55:45,697 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from NEW to NEW_SAVING
2015-02-12 14:55:45,697 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:55:45,697 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0035 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:55:45,698 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from SUBMITTED to ACCEPTED
2015-02-12 14:55:45,698 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0035
2015-02-12 14:55:45,698 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0035_000001
2015-02-12 14:55:45,698 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from NEW to SUBMITTED
2015-02-12 14:55:45,698 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0035_000001 to scheduler from user: soberoi
2015-02-12 14:55:45,699 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:55:45,701 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0035/
2015-02-12 14:55:45,701 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0035
2015-02-12 14:55:45,701 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0035/
2015-02-12 14:55:45,828 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:45,828 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000001
2015-02-12 14:55:45,828 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:55:45,829 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0035_01_000001
2015-02-12 14:55:45,829 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:45,829 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0035_000001
2015-02-12 14:55:45,830 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0035 AttemptId: appattempt_1423780884992_0035_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0035_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:55:45,832 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:55:45,832 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:55:45,833 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0035_000001
2015-02-12 14:55:45,835 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0035_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0035_000001
2015-02-12 14:55:45,835 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0035_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:55:45,835 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0035_000001
2015-02-12 14:55:45,836 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0035_000001
2015-02-12 14:55:45,838 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:45,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000001 by user soberoi
2015-02-12 14:55:45,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0035
2015-02-12 14:55:45,840 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000001
2015-02-12 14:55:45,841 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from NEW to INITING
2015-02-12 14:55:45,841 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000001 to application application_1423780884992_0035
2015-02-12 14:55:45,841 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from INITING to RUNNING
2015-02-12 14:55:45,841 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0035_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0035_000001
2015-02-12 14:55:45,841 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:55:45,841 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:55:45,842 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:45,842 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:55:45,842 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:55:45,842 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:55:45,842 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:45,842 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0035_01_000001
2015-02-12 14:55:45,859 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0035_01_000001.tokens. Credentials list:
2015-02-12 14:55:46,001 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:46,098 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:46,109 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0035_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000001.tokens
2015-02-12 14:55:46,109 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:55:46,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:46,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:46,252 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0035/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:46,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:46,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:46,311 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0035/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:46,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:46,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:55:46,385 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742210_1386 to datanode(s) 127.0.0.1:50543
2015-02-12 14:55:46,385 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742203_1379, blk_1073742204_1380, blk_1073742205_1381]
2015-02-12 14:55:46,385 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742202_1378, blk_1073742203_1379]
2015-02-12 14:55:46,396 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0035/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:46,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:46,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:46,467 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:46,467 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:46,511 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:46,511 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:46,640 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000001/default_container_executor.sh]
2015-02-12 14:55:46,830 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:47,103 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:47,154 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199 for deletion
2015-02-12 14:55:47,155 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200 for deletion
2015-02-12 14:55:47,155 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742202 for deletion
2015-02-12 14:55:47,155 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742203 for deletion
2015-02-12 14:55:47,155 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199
2015-02-12 14:55:47,155 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742202
2015-02-12 14:55:47,156 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200
2015-02-12 14:55:47,156 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742203
2015-02-12 14:55:47,529 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 to 127.0.0.1:50543
2015-02-12 14:55:47,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199 for deletion
2015-02-12 14:55:47,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200 for deletion
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742201 for deletion
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742203 for deletion
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742204 for deletion
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742201
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742204
2015-02-12 14:55:47,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742205_1381 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742205 for deletion
2015-02-12 14:55:47,531 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:55:47,531 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742203
2015-02-12 14:55:47,531 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 src: /127.0.0.1:54592 dest: /127.0.0.1:50543
2015-02-12 14:55:47,531 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742205_1381 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742205
2015-02-12 14:55:47,533 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386 src: /127.0.0.1:54592 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:55:47,533 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742210_1386 size 254067
2015-02-12 14:55:48,104 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:48,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:55:48,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:55:48,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:55:48,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:55:48,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035 dst=null perm=null proto=rpc
2015-02-12 14:55:48,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:55:48,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:55:49,109 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:49,201 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382
2015-02-12 14:55:49,387 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742202_1378, blk_1073742204_1380, blk_1073742205_1381]
2015-02-12 14:55:49,387 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742202_1378, blk_1073742203_1379, blk_1073742204_1380, blk_1073742205_1381]
2015-02-12 14:55:49,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:49,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:55:50,112 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:50,206 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199 for deletion
2015-02-12 14:55:50,206 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200 for deletion
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742201 for deletion
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742202 for deletion
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742204 for deletion
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742201
2015-02-12 14:55:50,207 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742205_1381 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742205 for deletion
2015-02-12 14:55:50,208 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742202
2015-02-12 14:55:50,208 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742204
2015-02-12 14:55:50,208 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742205_1381 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742205
2015-02-12 14:55:50,437 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0034_01_000001 succeeded
2015-02-12 14:55:50,437 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:55:50,437 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0034_01_000001
2015-02-12 14:55:50,477 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000001
2015-02-12 14:55:50,478 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000001
2015-02-12 14:55:50,478 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000001
2015-02-12 14:55:50,478 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0034_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:55:50,478 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000001
2015-02-12 14:55:50,478 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0034_01_000001 from application application_1423780884992_0034
2015-02-12 14:55:50,478 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:50,478 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0034
2015-02-12 14:55:50,479 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0034/container_1423780884992_0034_01_000001
2015-02-12 14:55:50,801 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199 for deletion
2015-02-12 14:55:50,801 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200 for deletion
2015-02-12 14:55:50,801 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742201 for deletion
2015-02-12 14:55:50,801 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742202 for deletion
2015-02-12 14:55:50,801 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742199
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742200
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742201
2015-02-12 14:55:50,801 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742203 for deletion
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742204 for deletion
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742205_1381 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742205 for deletion
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742202
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742204
2015-02-12 14:55:50,802 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742203
2015-02-12 14:55:50,803 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742205_1381 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742205
2015-02-12 14:55:51,113 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:51,134 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:51,137 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0035_000001
2015-02-12 14:55:51,137 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0035 APPATTEMPTID=appattempt_1423780884992_0035_000001
2015-02-12 14:55:51,137 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:55:51,137 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from ACCEPTED to RUNNING
2015-02-12 14:55:51,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:51,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:55:51,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:51,356 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0034_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:55:51,356 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0034_000001
2015-02-12 14:55:51,356 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0034_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:55:51,356 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000001
2015-02-12 14:55:51,356 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0034_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:55:51,356 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0034_000001 released container container_1423780884992_0034_01_000001 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:55:51,356 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0034_000001
2015-02-12 14:55:51,356 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0034_000001 State change from FINISHING to FINISHED
2015-02-12 14:55:51,357 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0034 State change from FINISHING to FINISHED
2015-02-12 14:55:51,357 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0034
2015-02-12 14:55:51,357 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0034,name=[6C0F7388F5554468A9793E65F911CB83/7F745DC9B357406C8B20406C7EC552F0] lower*upper/(1/1) ...ldedpipesplatform/unknown,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0034/jobhistory/job/job_1423780884992_0034,appMasterHost=10.1.1.67,startTime=1423781718357,finishTime=1423781744352,finalStatus=SUCCEEDED
2015-02-12 14:55:51,357 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0034_000001
2015-02-12 14:55:51,357 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0034_000001 is done. finalState=FINISHED
2015-02-12 14:55:51,358 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0034 requests cleared
2015-02-12 14:55:51,359 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0034_000001 (auth:SIMPLE)
2015-02-12 14:55:51,361 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0034_01_000001
2015-02-12 14:55:51,361 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0034 CONTAINERID=container_1423780884992_0034_01_000001
2015-02-12 14:55:51,362 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0034_01_000001]
2015-02-12 14:55:51,362 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:51,362 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:51,362 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,363 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,363 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0034
2015-02-12 14:55:51,363 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:51,363 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0034, with delay of 10800 seconds
2015-02-12 14:55:51,363 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,365 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,639 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:51,639 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,640 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,640 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,640 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,640 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0034
2015-02-12 14:55:51,641 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:51,641 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0034, with delay of 10800 seconds
2015-02-12 14:55:51,670 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:55:51,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390 src: /127.0.0.1:54652 dest: /127.0.0.1:50539
2015-02-12 14:55:51,734 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390 src: /127.0.0.1:54653 dest: /127.0.0.1:50546
2015-02-12 14:55:51,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390 src: /127.0.0.1:54654 dest: /127.0.0.1:50543
2015-02-12 14:55:51,777 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54654, dest: /127.0.0.1:50543, bytes: 115076, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390, duration: 38426000
2015-02-12 14:55:51,777 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:51,778 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:55:51,778 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54653, dest: /127.0.0.1:50546, bytes: 115076, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390, duration: 39096000
2015-02-12 14:55:51,778 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:51,779 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:51,779 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54652, dest: /127.0.0.1:50539, bytes: 115076, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390, duration: 40261000
2015-02-12 14:55:51,779 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:51,780 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:51,786 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:55:51,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:55:51,829 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:55:51,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391 src: /127.0.0.1:54655 dest: /127.0.0.1:50543
2015-02-12 14:55:51,838 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391 src: /127.0.0.1:54656 dest: /127.0.0.1:50549
2015-02-12 14:55:51,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391 src: /127.0.0.1:54657 dest: /127.0.0.1:50546
2015-02-12 14:55:51,844 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54657, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391, duration: 2237000
2015-02-12 14:55:51,845 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:55:51,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:51,845 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54656, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391, duration: 3012000
2015-02-12 14:55:51,846 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:51,846 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:51,847 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54655, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391, duration: 4137000
2015-02-12 14:55:51,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,849 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:55:51,848 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0034
2015-02-12 14:55:51,849 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:51,849 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0034, with delay of 10800 seconds
2015-02-12 14:55:51,849 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,850 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:51,850 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,850 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:51,851 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:55:51,856 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035.summary is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:55:52,114 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:55:52,114 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:52,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:52,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:52,115 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:52,115 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0034
2015-02-12 14:55:52,116 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:55:52,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0034
2015-02-12 14:55:52,116 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0034, with delay of 10800 seconds
2015-02-12 14:55:52,367 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:52,367 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000002
2015-02-12 14:55:52,367 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:52,644 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:52,645 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000003
2015-02-12 14:55:52,645 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:52,851 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:52,851 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000004
2015-02-12 14:55:52,851 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:55:52,926 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389
2015-02-12 14:55:53,115 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:55:53,115 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:53,115 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000005
2015-02-12 14:55:53,116 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:55:53,127 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386
2015-02-12 14:55:53,128 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382
2015-02-12 14:55:53,129 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383
2015-02-12 14:55:53,130 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384
2015-02-12 14:55:53,130 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387
2015-02-12 14:55:53,160 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386
2015-02-12 14:55:53,161 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383
2015-02-12 14:55:53,161 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387
2015-02-12 14:55:53,210 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0035_01_000002
2015-02-12 14:55:53,210 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:53,211 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0035_01_000003
2015-02-12 14:55:53,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:53,211 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0035_01_000004
2015-02-12 14:55:53,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:53,211 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0035_01_000005
2015-02-12 14:55:53,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:53,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:53,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:53,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:55:53,332 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385
2015-02-12 14:55:53,332 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388
2015-02-12 14:55:53,362 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385
2015-02-12 14:55:53,372 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:53,372 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000006
2015-02-12 14:55:53,372 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:55:53,401 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:53,402 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:53,403 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:53,404 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:53,410 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000005 by user soberoi
2015-02-12 14:55:53,410 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000002 by user soberoi
2015-02-12 14:55:53,410 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000004 by user soberoi
2015-02-12 14:55:53,410 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0035
2015-02-12 14:55:53,411 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000004
2015-02-12 14:55:53,411 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000002
2015-02-12 14:55:53,411 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from NEW to INITING
2015-02-12 14:55:53,411 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000002 to application application_1423780884992_0035
2015-02-12 14:55:53,410 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000003 by user soberoi
2015-02-12 14:55:53,411 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from INITING to RUNNING
2015-02-12 14:55:53,411 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000004 to application application_1423780884992_0035
2015-02-12 14:55:53,412 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:55:53,412 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,412 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:55:53,412 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,412 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,412 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:53,412 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0035
2015-02-12 14:55:53,410 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0035
2015-02-12 14:55:53,413 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000005
2015-02-12 14:55:53,413 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:53,412 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,413 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:53,413 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0035
2015-02-12 14:55:53,414 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:53,414 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from NEW to INITING
2015-02-12 14:55:53,414 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000005 to application application_1423780884992_0035
2015-02-12 14:55:53,414 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from INITING to RUNNING
2015-02-12 14:55:53,414 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:55:53,414 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,414 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,415 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:53,415 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0035
2015-02-12 14:55:53,415 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:53,415 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:53,415 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0035_01_000005
2015-02-12 14:55:53,411 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0035
2015-02-12 14:55:53,419 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000003
2015-02-12 14:55:53,414 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:53,420 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0035_01_000002
2015-02-12 14:55:53,420 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from NEW to INITING
2015-02-12 14:55:53,421 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000003 to application application_1423780884992_0035
2015-02-12 14:55:53,421 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from INITING to RUNNING
2015-02-12 14:55:53,421 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:55:53,421 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,422 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0035
2015-02-12 14:55:53,422 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:53,422 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0035
2015-02-12 14:55:53,422 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:55:53,424 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:55:53,425 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0035_01_000003
2015-02-12 14:55:53,455 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0035_01_000002.tokens. Credentials list:
2015-02-12 14:55:53,457 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0035_01_000005.tokens. Credentials list:
2015-02-12 14:55:53,462 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0035_01_000003.tokens. Credentials list:
2015-02-12 14:55:53,545 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:53,545 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:53,647 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:53,679 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:53,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:53,692 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:53,796 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000004/default_container_executor.sh]
2015-02-12 14:55:53,853 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:53,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0035_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000003.tokens
2015-02-12 14:55:53,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:55:53,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423780884992_0035_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000002.tokens
2015-02-12 14:55:53,900 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:55:53,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0035_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000005.tokens
2015-02-12 14:55:53,919 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:55:53,989 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387
2015-02-12 14:55:53,991 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742206_1382
2015-02-12 14:55:53,991 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742207_1383
2015-02-12 14:55:53,993 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388
2015-02-12 14:55:53,994 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389
2015-02-12 14:55:53,995 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384
2015-02-12 14:55:54,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:54,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:54,117 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:54,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:54,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:54,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:54,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar dst=null perm=null proto=rpc
2015-02-12 14:55:54,199 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0035/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:54,209 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742212_1388
2015-02-12 14:55:54,211 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386
2015-02-12 14:55:54,235 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:54,246 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:55:54,250 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000006 by user soberoi
2015-02-12 14:55:54,250 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000006
2015-02-12 14:55:54,251 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000006 to application application_1423780884992_0035
2015-02-12 14:55:54,251 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:55:54,251 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:55:54,251 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0035
2015-02-12 14:55:54,251 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:55:54,251 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0035
2015-02-12 14:55:54,252 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0035_01_000006
2015-02-12 14:55:54,259 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0035/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:54,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:54,264 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0035/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:54,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:54,272 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0035_01_000006.tokens. Credentials list:
2015-02-12 14:55:54,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:54,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:54,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:54,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml dst=null perm=null proto=rpc
2015-02-12 14:55:54,343 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0035/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:54,343 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:54,343 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:54,375 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:54,375 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:55:54,376 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:55:54,376 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000007
2015-02-12 14:55:54,376 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:55:54,395 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742210_1386
2015-02-12 14:55:54,401 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0035/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:54,402 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:54,404 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:54,404 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:54,412 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742209_1385
2015-02-12 14:55:54,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742208_1384
2015-02-12 14:55:54,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742211_1387
2015-02-12 14:55:54,418 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:54,418 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:54,449 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0035/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:55:54,449 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:55:54,468 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:54,468 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:54,505 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:55:54,506 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:55:54,612 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742213_1389
2015-02-12 14:55:54,705 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000002/default_container_executor.sh]
2015-02-12 14:55:54,728 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000006/default_container_executor.sh]
2015-02-12 14:55:54,762 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000005/default_container_executor.sh]
2015-02-12 14:55:54,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000003/default_container_executor.sh]
2015-02-12 14:55:55,240 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:55:55,240 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:55:55,374 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:55:55,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0035_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000006.tokens
2015-02-12 14:55:55,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:55:56,245 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:55:56,246 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:55:56,246 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000007
2015-02-12 14:55:56,246 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:55:56,246 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000007 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:55:56,378 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0035_01_000007
2015-02-12 14:55:58,337 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390
2015-02-12 14:55:58,367 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391
2015-02-12 14:55:58,368 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390
2015-02-12 14:55:59,401 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742214_1390
2015-02-12 14:55:59,401 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391
2015-02-12 14:55:59,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742215_1391
2015-02-12 14:56:00,029 INFO datanode.DirectoryScanner (DirectoryScanner.java:scan(484)) - BlockPool BP-1595598241-10.1.1.67-1423780868362 Total blocks: 92, missing metadata files:0, missing block files:0, missing blocks in memory:0, mismatched blocks:0
2015-02-12 14:56:04,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:04,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:04,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:04,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:04,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:04,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:04,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:04,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:04,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:04,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:05,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:56:05,369 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:05,371 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000004
2015-02-12 14:56:05,371 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000004
2015-02-12 14:56:05,371 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:56:05,371 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000004
2015-02-12 14:56:05,391 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:56:05,391 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 3119 Total time for transactions(ms): 253 Number of transactions batched in Syncs: 9 Number of syncs: 2165 SyncTimes(ms): 739 522
2015-02-12 14:56:05,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392 src: /127.0.0.1:54694 dest: /127.0.0.1:50549
2015-02-12 14:56:05,396 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0035_01_000004 is : 143
2015-02-12 14:56:05,399 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392 src: /127.0.0.1:54695 dest: /127.0.0.1:50546
2015-02-12 14:56:05,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392 src: /127.0.0.1:54696 dest: /127.0.0.1:50539
2015-02-12 14:56:05,431 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:05,433 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000004
2015-02-12 14:56:05,433 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:05,433 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000004 from application application_1423780884992_0035
2015-02-12 14:56:05,433 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:05,433 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:05,434 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000004
2015-02-12 14:56:05,434 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000004
2015-02-12 14:56:05,434 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist for DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:05,434 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000004
2015-02-12 14:56:05,435 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000004
2015-02-12 14:56:05,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:56:05,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:56:05,660 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:05,661 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000003
2015-02-12 14:56:05,662 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000003
2015-02-12 14:56:05,662 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:56:05,662 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000003
2015-02-12 14:56:05,680 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0035_01_000003 is : 143
2015-02-12 14:56:05,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:56:05,692 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:05,693 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000003
2015-02-12 14:56:05,693 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000003
2015-02-12 14:56:05,694 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000003
2015-02-12 14:56:05,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000003
2015-02-12 14:56:05,694 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000003
2015-02-12 14:56:05,696 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:05,696 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000003 from application application_1423780884992_0035
2015-02-12 14:56:05,697 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:05,697 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:05,704 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:05,706 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000002
2015-02-12 14:56:05,707 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000002
2015-02-12 14:56:05,707 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:56:05,708 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000002
2015-02-12 14:56:05,726 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0035_01_000002 is : 143
2015-02-12 14:56:05,750 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:05,754 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:05,754 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000006
2015-02-12 14:56:05,754 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000006
2015-02-12 14:56:05,756 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:56:05,756 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000002
2015-02-12 14:56:05,756 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:05,756 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000006
2015-02-12 14:56:05,757 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000002
2015-02-12 14:56:05,758 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000002
2015-02-12 14:56:05,758 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:05,758 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:56:05,758 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000002
2015-02-12 14:56:05,758 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000002
2015-02-12 14:56:05,758 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000002
2015-02-12 14:56:05,759 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:56:05,759 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000002 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:56:05,783 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0035_01_000006 is : 143
2015-02-12 14:56:05,793 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000002 from application application_1423780884992_0035
2015-02-12 14:56:05,793 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:05,793 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:05,793 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:05,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000006
2015-02-12 14:56:05,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000006
2015-02-12 14:56:05,794 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000006
2015-02-12 14:56:05,794 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000006
2015-02-12 14:56:05,794 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:05,795 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000006 from application application_1423780884992_0035
2015-02-12 14:56:05,795 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:05,795 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:05,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000006
2015-02-12 14:56:05,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:56:05,898 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:05,899 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000005
2015-02-12 14:56:05,900 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000005
2015-02-12 14:56:05,900 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:56:05,900 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000005
2015-02-12 14:56:05,921 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0035_01_000005 is : 143
2015-02-12 14:56:05,934 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:05,938 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000005
2015-02-12 14:56:05,944 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000005
2015-02-12 14:56:05,946 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000005
2015-02-12 14:56:05,946 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:05,947 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000005 from application application_1423780884992_0035
2015-02-12 14:56:05,947 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:05,947 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:05,947 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000005
2015-02-12 14:56:05,947 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000005
2015-02-12 14:56:06,377 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:06,377 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:56:06,377 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000004
2015-02-12 14:56:06,378 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:56:06,378 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000004 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:56:06,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:06,668 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:56:06,668 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000003
2015-02-12 14:56:06,668 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:06,669 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000003 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:06,761 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:06,761 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:06,761 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:56:06,761 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000006
2015-02-12 14:56:06,762 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:06,762 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000006 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:06,904 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:06,904 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:56:06,904 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000005
2015-02-12 14:56:06,904 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:06,904 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000005 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:07,378 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:07,378 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:07,378 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000008
2015-02-12 14:56:07,378 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0035_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:56:07,673 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:07,764 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0035_01_000002]
2015-02-12 14:56:07,764 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:07,764 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:07,905 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:08,305 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:08,315 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:08,317 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0035_01_000008 by user soberoi
2015-02-12 14:56:08,317 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000008
2015-02-12 14:56:08,317 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0035_01_000008 to application application_1423780884992_0035
2015-02-12 14:56:08,318 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:56:08,318 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0035
2015-02-12 14:56:08,318 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0035
2015-02-12 14:56:08,318 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:08,318 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0035
2015-02-12 14:56:08,319 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:08,352 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:08,352 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:08,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0035_01_000004]
2015-02-12 14:56:08,378 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:08,379 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:08,466 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000008/default_container_executor.sh]
2015-02-12 14:56:08,673 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0035_01_000003]
2015-02-12 14:56:08,674 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:08,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0035_01_000006]
2015-02-12 14:56:08,768 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:08,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0035_01_000005]
2015-02-12 14:56:08,906 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:09,309 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:56:09,616 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:56:09,616 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:56:11,218 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:11,223 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:11,227 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:11,229 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:11,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,554 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:56:11,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393 src: /127.0.0.1:54711 dest: /127.0.0.1:50546
2015-02-12 14:56:11,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393 src: /127.0.0.1:54712 dest: /127.0.0.1:50549
2015-02-12 14:56:11,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393 src: /127.0.0.1:54713 dest: /127.0.0.1:50543
2015-02-12 14:56:11,706 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54713, dest: /127.0.0.1:50543, bytes: 170, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0035_r_000000_0_-696978919_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393, duration: 41018000
2015-02-12 14:56:11,706 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:11,706 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,707 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54712, dest: /127.0.0.1:50549, bytes: 170, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0035_r_000000_0_-696978919_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393, duration: 41025000
2015-02-12 14:56:11,707 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,707 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,707 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54711, dest: /127.0.0.1:50546, bytes: 170, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0035_r_000000_0_-696978919_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393, duration: 42785000
2015-02-12 14:56:11,708 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,708 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,713 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0035_r_000000_0_-696978919_1
2015-02-12 14:56:11,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:56:11,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:56:11,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/task_1423780884992_0035_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:56:11,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/_temporary/attempt_1423780884992_0035_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/task_1423780884992_0035_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:56:11,762 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:11,763 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000008
2015-02-12 14:56:11,764 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000008
2015-02-12 14:56:11,764 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:56:11,764 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000008
2015-02-12 14:56:11,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,780 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:56:11,790 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0035_01_000008 is : 143
2015-02-12 14:56:11,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:11,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:11,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/task_1423780884992_0035_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:56:11,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:11,803 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:11,804 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000008
2015-02-12 14:56:11,804 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000008
2015-02-12 14:56:11,804 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000008
2015-02-12 14:56:11,804 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000008
2015-02-12 14:56:11,805 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:11,805 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000008 from application application_1423780884992_0035
2015-02-12 14:56:11,805 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:11,805 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:11,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary/1/task_1423780884992_0035_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000008
2015-02-12 14:56:11,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:56:11,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,822 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,826 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,844 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54696, dest: /127.0.0.1:50539, bytes: 69223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392, duration: 6434867000
2015-02-12 14:56:11,844 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:11,844 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16374
2015-02-12 14:56:11,846 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54695, dest: /127.0.0.1:50546, bytes: 69223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392, duration: 6423403000
2015-02-12 14:56:11,846 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16374
2015-02-12 14:56:11,848 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54694, dest: /127.0.0.1:50549, bytes: 69223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392, duration: 6430860000
2015-02-12 14:56:11,848 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742216_1392, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,848 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 16374
2015-02-12 14:56:11,850 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,857 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:56:11,859 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394 src: /127.0.0.1:54715 dest: /127.0.0.1:50539
2015-02-12 14:56:11,861 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394 src: /127.0.0.1:54716 dest: /127.0.0.1:50543
2015-02-12 14:56:11,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394 src: /127.0.0.1:54717 dest: /127.0.0.1:50546
2015-02-12 14:56:11,870 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54717, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394, duration: 1420000
2015-02-12 14:56:11,870 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:11,870 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,871 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54716, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394, duration: 3556000
2015-02-12 14:56:11,871 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,873 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54715, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394, duration: 5312000
2015-02-12 14:56:11,873 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,876 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742218_1394 size 455
2015-02-12 14:56:11,876 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:11,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:56:11,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:11,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:56:11,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:11,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:56:11,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,907 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:56:11,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395 src: /127.0.0.1:54719 dest: /127.0.0.1:50543
2015-02-12 14:56:11,914 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395 src: /127.0.0.1:54720 dest: /127.0.0.1:50546
2015-02-12 14:56:11,916 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395 src: /127.0.0.1:54721 dest: /127.0.0.1:50549
2015-02-12 14:56:11,919 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54721, dest: /127.0.0.1:50549, bytes: 69223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395, duration: 1903000
2015-02-12 14:56:11,919 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:11,920 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,920 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54720, dest: /127.0.0.1:50546, bytes: 69223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395, duration: 2573000
2015-02-12 14:56:11,920 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,921 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,921 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54719, dest: /127.0.0.1:50543, bytes: 69223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395, duration: 3520000
2015-02-12 14:56:11,921 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,922 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,924 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:11,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:56:11,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:11,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:56:11,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:11,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035/job_1423780884992_0035_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:56:11,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:11,939 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:56:11,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396 src: /127.0.0.1:54723 dest: /127.0.0.1:50539
2015-02-12 14:56:11,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396 src: /127.0.0.1:54724 dest: /127.0.0.1:50549
2015-02-12 14:56:11,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396 src: /127.0.0.1:54725 dest: /127.0.0.1:50543
2015-02-12 14:56:11,950 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54725, dest: /127.0.0.1:50543, bytes: 115076, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396, duration: 1814000
2015-02-12 14:56:11,950 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:11,950 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:56:11,950 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54724, dest: /127.0.0.1:50549, bytes: 115076, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396, duration: 2434000
2015-02-12 14:56:11,951 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,951 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,951 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54723, dest: /127.0.0.1:50539, bytes: 115076, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1889004889_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396, duration: 3339000
2015-02-12 14:56:11,951 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:11,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:11,955 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1889004889_1
2015-02-12 14:56:11,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:11,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:11,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:11,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:11,976 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0035_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:56:11,976 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:56:11,976 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0035 with final state: FINISHING
2015-02-12 14:56:11,976 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from RUNNING to FINAL_SAVING
2015-02-12 14:56:11,976 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:56:11,976 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0035
2015-02-12 14:56:11,977 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from FINAL_SAVING to FINISHING
2015-02-12 14:56:12,765 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:12,765 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:56:12,765 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000008
2015-02-12 14:56:12,765 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:56:12,766 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000008 on node: host: 10.1.1.67:50575 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:56:12,984 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0035 unregistered successfully.
2015-02-12 14:56:12,987 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742210_1386 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:56:12,987 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742211_1387 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:56:12,988 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742212_1388 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:56:12,988 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742213_1389 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:56:12,988 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742215_1391 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:56:12,988 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742216_1392 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:56:12,988 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742214_1390 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:56:12,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0035 dst=null perm=null proto=rpc
2015-02-12 14:56:13,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,055 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary
2015-02-12 14:56:13,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:56:13,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,077 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:13,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:13,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:13,112 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:13,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:13,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,137 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:56:13,137 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:56:13,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:56:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:56:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:56:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup"]
2015-02-12 14:56:13,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:56:13,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:56:13,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:56:13,162 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...uterinnernull-resultgroup
2015-02-12 14:56:13,177 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:56:13,188 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:56:13,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:13,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:56:13,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:56:13,196 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 36
2015-02-12 14:56:13,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036 dst=null perm=null proto=rpc
2015-02-12 14:56:13,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:56:13,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:56:13,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,209 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:56:13,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 src: /127.0.0.1:54730 dest: /127.0.0.1:50549
2015-02-12 14:56:13,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 src: /127.0.0.1:54731 dest: /127.0.0.1:50543
2015-02-12 14:56:13,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 src: /127.0.0.1:54732 dest: /127.0.0.1:50546
2015-02-12 14:56:13,229 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54732, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397, duration: 4502000
2015-02-12 14:56:13,230 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:13,232 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54731, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397, duration: 7065000
2015-02-12 14:56:13,232 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,232 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,233 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54730, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397, duration: 9398000
2015-02-12 14:56:13,233 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,237 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:13,238 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar
2015-02-12 14:56:13,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:56:13,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:56:13,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:56:13,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:56:13,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:56:13,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,255 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:13,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,259 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:13,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,267 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:13,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,270 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:13,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:13,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,276 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split
2015-02-12 14:56:13,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:13,278 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:56:13,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398 src: /127.0.0.1:54733 dest: /127.0.0.1:50539
2015-02-12 14:56:13,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398 src: /127.0.0.1:54734 dest: /127.0.0.1:50546
2015-02-12 14:56:13,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398 src: /127.0.0.1:54735 dest: /127.0.0.1:50543
2015-02-12 14:56:13,284 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398 src: /127.0.0.1:54736 dest: /127.0.0.1:50549
2015-02-12 14:56:13,287 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54736, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, duration: 1600000
2015-02-12 14:56:13,287 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:13,288 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54735, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, duration: 2127000
2015-02-12 14:56:13,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:56:13,288 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,289 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54734, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, duration: 3631000
2015-02-12 14:56:13,290 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,292 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54733, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, duration: 6193000
2015-02-12 14:56:13,292 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,294 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,295 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,297 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:13,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,301 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:56:13,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399 src: /127.0.0.1:54737 dest: /127.0.0.1:50549
2015-02-12 14:56:13,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399 src: /127.0.0.1:54738 dest: /127.0.0.1:50543
2015-02-12 14:56:13,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399 src: /127.0.0.1:54739 dest: /127.0.0.1:50539
2015-02-12 14:56:13,311 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54739, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399, duration: 2984000
2015-02-12 14:56:13,311 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:13,312 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,312 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54738, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399, duration: 2625000
2015-02-12 14:56:13,312 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,313 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,313 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54737, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399, duration: 3954000
2015-02-12 14:56:13,313 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,315 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,316 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:13,317 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:56:13,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:13,327 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:56:13,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400 src: /127.0.0.1:54740 dest: /127.0.0.1:50543
2015-02-12 14:56:13,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400 src: /127.0.0.1:54741 dest: /127.0.0.1:50546
2015-02-12 14:56:13,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400 src: /127.0.0.1:54742 dest: /127.0.0.1:50549
2015-02-12 14:56:13,338 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54742, dest: /127.0.0.1:50549, bytes: 98373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400, duration: 1646000
2015-02-12 14:56:13,338 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:13,339 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,339 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54741, dest: /127.0.0.1:50546, bytes: 98373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400, duration: 2083000
2015-02-12 14:56:13,340 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,341 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54740, dest: /127.0.0.1:50543, bytes: 98373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400, duration: 3707000
2015-02-12 14:56:13,341 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:13,343 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:13,344 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:13,344 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0036
2015-02-12 14:56:13,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036 dst=null perm=null proto=rpc
2015-02-12 14:56:13,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:13,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:13,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:13,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:13,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:13,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:13,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:13,358 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 36 submitted by user soberoi
2015-02-12 14:56:13,358 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0036
2015-02-12 14:56:13,358 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from NEW to NEW_SAVING
2015-02-12 14:56:13,359 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0036
2015-02-12 14:56:13,358 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0036
2015-02-12 14:56:13,360 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:56:13,360 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0036 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:56:13,361 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from SUBMITTED to ACCEPTED
2015-02-12 14:56:13,361 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0036_000001
2015-02-12 14:56:13,361 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from NEW to SUBMITTED
2015-02-12 14:56:13,361 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0036_000001 to scheduler from user: soberoi
2015-02-12 14:56:13,362 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:56:13,362 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0036
2015-02-12 14:56:13,365 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0036/
2015-02-12 14:56:13,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0036
2015-02-12 14:56:13,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0036/
2015-02-12 14:56:13,411 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742221_1397 to datanode(s) 127.0.0.1:50539
2015-02-12 14:56:13,412 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742210_1386, blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742215_1391, blk_1073742216_1392]
2015-02-12 14:56:13,412 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742210_1386, blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742214_1390, blk_1073742216_1392]
2015-02-12 14:56:13,692 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:13,693 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000001
2015-02-12 14:56:13,693 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:56:13,693 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0036_01_000001
2015-02-12 14:56:13,693 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:13,694 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0036_000001
2015-02-12 14:56:13,694 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0036 AttemptId: appattempt_1423780884992_0036_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0036_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:56:13,694 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:56:13,694 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:56:13,695 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0036_000001
2015-02-12 14:56:13,696 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0036_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0036_000001
2015-02-12 14:56:13,696 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0036_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:56:13,696 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0036_000001
2015-02-12 14:56:13,696 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0036_000001
2015-02-12 14:56:13,698 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:13,700 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000001 by user soberoi
2015-02-12 14:56:13,700 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0036
2015-02-12 14:56:13,700 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000001
2015-02-12 14:56:13,700 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from NEW to INITING
2015-02-12 14:56:13,700 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000001 to application application_1423780884992_0036
2015-02-12 14:56:13,701 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from INITING to RUNNING
2015-02-12 14:56:13,701 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0036_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0036_000001
2015-02-12 14:56:13,701 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:56:13,701 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:56:13,701 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:13,701 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:13,701 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:56:13,702 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:56:13,702 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:13,702 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0036_01_000001
2015-02-12 14:56:13,713 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0036_01_000001.tokens. Credentials list:
2015-02-12 14:56:13,768 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:13,832 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:13,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0036_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000001.tokens
2015-02-12 14:56:13,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:14,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:14,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:14,141 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0036/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:14,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:14,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:14,218 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:14,232 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210 for deletion
2015-02-12 14:56:14,232 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211 for deletion
2015-02-12 14:56:14,233 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742212 for deletion
2015-02-12 14:56:14,233 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742213 for deletion
2015-02-12 14:56:14,233 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742214 for deletion
2015-02-12 14:56:14,233 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742216_1392 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742216 for deletion
2015-02-12 14:56:14,233 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210
2015-02-12 14:56:14,233 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211
2015-02-12 14:56:14,234 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742213
2015-02-12 14:56:14,234 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742212
2015-02-12 14:56:14,235 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742214
2015-02-12 14:56:14,235 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742216_1392 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742216
2015-02-12 14:56:14,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:14,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:14,295 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:14,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:14,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:14,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0036/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:14,366 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:14,402 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:14,403 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:14,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000001/default_container_executor.sh]
2015-02-12 14:56:14,695 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:14,770 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:14,817 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 to 127.0.0.1:50539
2015-02-12 14:56:14,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210 for deletion
2015-02-12 14:56:14,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211 for deletion
2015-02-12 14:56:14,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742212 for deletion
2015-02-12 14:56:14,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742213 for deletion
2015-02-12 14:56:14,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210
2015-02-12 14:56:14,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742212
2015-02-12 14:56:14,819 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 (numBytes=254067) to /127.0.0.1:50539
2015-02-12 14:56:14,819 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211
2015-02-12 14:56:14,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742215 for deletion
2015-02-12 14:56:14,819 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742216_1392 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742216 for deletion
2015-02-12 14:56:14,819 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742213
2015-02-12 14:56:14,819 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742215
2015-02-12 14:56:14,820 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742216_1392 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742216
2015-02-12 14:56:14,820 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 src: /127.0.0.1:54747 dest: /127.0.0.1:50539
2015-02-12 14:56:14,822 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397 src: /127.0.0.1:54747 dest: /127.0.0.1:50539 of size 254067
2015-02-12 14:56:14,823 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742221_1397 size 254067
2015-02-12 14:56:15,774 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:16,415 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742210_1386, blk_1073742211_1387, blk_1073742214_1390, blk_1073742215_1391]
2015-02-12 14:56:16,415 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742210_1386, blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742214_1390, blk_1073742215_1391, blk_1073742216_1392]
2015-02-12 14:56:16,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:56:16,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:56:16,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:56:16,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:56:16,775 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:16,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036 dst=null perm=null proto=rpc
2015-02-12 14:56:16,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:56:16,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:56:17,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210 for deletion
2015-02-12 14:56:17,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211 for deletion
2015-02-12 14:56:17,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742214 for deletion
2015-02-12 14:56:17,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742215 for deletion
2015-02-12 14:56:17,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210
2015-02-12 14:56:17,188 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211
2015-02-12 14:56:17,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742215
2015-02-12 14:56:17,189 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742214
2015-02-12 14:56:17,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:17,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:17,551 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210 for deletion
2015-02-12 14:56:17,551 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211 for deletion
2015-02-12 14:56:17,551 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742212 for deletion
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742213 for deletion
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742214 for deletion
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742210_1386 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742210
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742215 for deletion
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742216_1392 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742216 for deletion
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742212
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742211
2015-02-12 14:56:17,552 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742214
2015-02-12 14:56:17,553 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742213
2015-02-12 14:56:17,553 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742216_1392 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742216
2015-02-12 14:56:17,553 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742215
2015-02-12 14:56:17,780 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:18,036 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0035_01_000001 succeeded
2015-02-12 14:56:18,037 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:56:18,037 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0035_01_000001
2015-02-12 14:56:18,054 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000001
2015-02-12 14:56:18,054 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000001
2015-02-12 14:56:18,055 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000001
2015-02-12 14:56:18,055 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000001
2015-02-12 14:56:18,055 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0035_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:56:18,055 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0035_01_000001 from application application_1423780884992_0035
2015-02-12 14:56:18,055 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:18,055 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0035
2015-02-12 14:56:18,055 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035/container_1423780884992_0035_01_000001
2015-02-12 14:56:18,355 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396
2015-02-12 14:56:18,355 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394
2015-02-12 14:56:18,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399
2015-02-12 14:56:18,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398
2015-02-12 14:56:18,387 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398
2015-02-12 14:56:18,388 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399
2015-02-12 14:56:18,388 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394
2015-02-12 14:56:18,423 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:18,424 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0036_000001
2015-02-12 14:56:18,425 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0036 APPATTEMPTID=appattempt_1423780884992_0036_000001
2015-02-12 14:56:18,425 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:56:18,425 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from ACCEPTED to RUNNING
2015-02-12 14:56:18,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:18,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:56:18,591 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397
2015-02-12 14:56:18,592 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393
2015-02-12 14:56:18,594 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400
2015-02-12 14:56:18,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:18,781 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0035_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:18,781 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0035_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:56:18,781 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0035_000001
2015-02-12 14:56:18,782 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0035_000001
2015-02-12 14:56:18,782 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0035_000001 State change from FINISHING to FINISHED
2015-02-12 14:56:18,782 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0035 State change from FINISHING to FINISHED
2015-02-12 14:56:18,782 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0035
2015-02-12 14:56:18,782 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0035,name=[1F7009B451D84D1CA3B2130302914513/F4EE99BDD37C406C855E33B2B64074F4] lower*upper/(1/1) ...orm/cogroupouterinnernull,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0035/jobhistory/job/job_1423780884992_0035,appMasterHost=10.1.1.67,startTime=1423781745696,finishTime=1423781771976,finalStatus=SUCCEEDED
2015-02-12 14:56:18,782 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000001
2015-02-12 14:56:18,782 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0035_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:18,783 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0035_000001 released container container_1423780884992_0035_01_000001 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:18,783 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:18,783 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0035_000001
2015-02-12 14:56:18,783 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0035_000001 is done. finalState=FINISHED
2015-02-12 14:56:18,783 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0035 requests cleared
2015-02-12 14:56:18,785 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0035_000001 (auth:SIMPLE)
2015-02-12 14:56:18,787 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0035_01_000001
2015-02-12 14:56:18,787 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0035 CONTAINERID=container_1423780884992_0035_01_000001
2015-02-12 14:56:18,787 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0035_01_000001]
2015-02-12 14:56:18,788 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:18,788 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:18,788 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:18,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,789 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0035
2015-02-12 14:56:18,789 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:18,789 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0035, with delay of 10800 seconds
2015-02-12 14:56:18,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,792 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396
2015-02-12 14:56:18,793 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395
2015-02-12 14:56:18,801 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:18,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,802 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0035
2015-02-12 14:56:18,802 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:18,802 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0035, with delay of 10800 seconds
2015-02-12 14:56:18,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,906 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:56:18,931 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:18,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,932 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0035
2015-02-12 14:56:18,933 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:18,933 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0035, with delay of 10800 seconds
2015-02-12 14:56:18,933 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,933 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,934 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:18,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401 src: /127.0.0.1:54758 dest: /127.0.0.1:50549
2015-02-12 14:56:18,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401 src: /127.0.0.1:54759 dest: /127.0.0.1:50543
2015-02-12 14:56:18,966 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401 src: /127.0.0.1:54760 dest: /127.0.0.1:50539
2015-02-12 14:56:19,010 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54760, dest: /127.0.0.1:50539, bytes: 115088, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401, duration: 42242000
2015-02-12 14:56:19,010 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:19,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:56:19,011 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54759, dest: /127.0.0.1:50543, bytes: 115088, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401, duration: 42685000
2015-02-12 14:56:19,011 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:19,012 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54758, dest: /127.0.0.1:50549, bytes: 115088, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401, duration: 43896000
2015-02-12 14:56:19,012 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:19,015 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:56:19,016 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:56:19,031 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:19,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:19,074 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:56:19,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402 src: /127.0.0.1:54761 dest: /127.0.0.1:50546
2015-02-12 14:56:19,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402 src: /127.0.0.1:54762 dest: /127.0.0.1:50549
2015-02-12 14:56:19,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402 src: /127.0.0.1:54763 dest: /127.0.0.1:50543
2015-02-12 14:56:19,083 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54763, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402, duration: 1611000
2015-02-12 14:56:19,084 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:19,084 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:19,084 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54762, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402, duration: 2416000
2015-02-12 14:56:19,085 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:19,086 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54761, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402, duration: 3617000
2015-02-12 14:56:19,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:19,086 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:19,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:19,089 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036.summary is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:19,417 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742218_1394
2015-02-12 14:56:19,417 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398
2015-02-12 14:56:19,418 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400
2015-02-12 14:56:19,420 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395
2015-02-12 14:56:19,421 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393
2015-02-12 14:56:19,624 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397
2015-02-12 14:56:19,640 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742224_1400
2015-02-12 14:56:19,641 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742222_1398
2015-02-12 14:56:19,642 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742220_1396
2015-02-12 14:56:19,643 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742223_1399
2015-02-12 14:56:19,644 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742219_1395
2015-02-12 14:56:19,705 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:19,705 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:19,705 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000002
2015-02-12 14:56:19,706 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:56:19,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:19,706 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0035
2015-02-12 14:56:19,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:19,706 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:19,707 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0035, with delay of 10800 seconds
2015-02-12 14:56:19,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:19,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0035
2015-02-12 14:56:19,791 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:19,791 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:19,791 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000003
2015-02-12 14:56:19,791 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:19,805 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:19,805 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000004
2015-02-12 14:56:19,805 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:19,846 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397
2015-02-12 14:56:19,848 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742217_1393
2015-02-12 14:56:19,936 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:19,936 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000005
2015-02-12 14:56:19,936 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:20,501 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0036_01_000002
2015-02-12 14:56:20,501 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:20,502 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0036_01_000003
2015-02-12 14:56:20,502 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:20,502 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0036_01_000004
2015-02-12 14:56:20,502 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:20,502 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0036_01_000005
2015-02-12 14:56:20,503 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:20,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:20,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:20,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:20,706 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:20,706 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000006
2015-02-12 14:56:20,706 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:56:20,741 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:20,742 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:20,742 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:20,747 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000002 by user soberoi
2015-02-12 14:56:20,747 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000002
2015-02-12 14:56:20,748 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000002 to application application_1423780884992_0036
2015-02-12 14:56:20,748 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:56:20,748 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,748 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,748 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:20,748 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0036
2015-02-12 14:56:20,749 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:20,760 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000004 by user soberoi
2015-02-12 14:56:20,760 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0036
2015-02-12 14:56:20,760 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000004
2015-02-12 14:56:20,761 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from NEW to INITING
2015-02-12 14:56:20,761 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000004 to application application_1423780884992_0036
2015-02-12 14:56:20,761 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from INITING to RUNNING
2015-02-12 14:56:20,761 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:56:20,761 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,761 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,761 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:20,761 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0036
2015-02-12 14:56:20,762 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:20,762 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:20,762 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0036_01_000004
2015-02-12 14:56:20,784 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000005 by user soberoi
2015-02-12 14:56:20,784 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:20,784 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0036
2015-02-12 14:56:20,784 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000005
2015-02-12 14:56:20,784 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from NEW to INITING
2015-02-12 14:56:20,784 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000005 to application application_1423780884992_0036
2015-02-12 14:56:20,785 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from INITING to RUNNING
2015-02-12 14:56:20,785 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:56:20,785 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,785 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,785 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:20,785 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0036
2015-02-12 14:56:20,785 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:20,785 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:20,786 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0036_01_000005
2015-02-12 14:56:20,789 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000003 by user soberoi
2015-02-12 14:56:20,789 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0036
2015-02-12 14:56:20,790 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000003
2015-02-12 14:56:20,790 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from NEW to INITING
2015-02-12 14:56:20,791 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000003 to application application_1423780884992_0036
2015-02-12 14:56:20,791 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from INITING to RUNNING
2015-02-12 14:56:20,792 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:56:20,792 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,792 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0036
2015-02-12 14:56:20,792 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:20,792 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0036
2015-02-12 14:56:20,793 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:20,793 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:20,793 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:20,793 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0036_01_000003
2015-02-12 14:56:20,794 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0036_01_000004.tokens. Credentials list:
2015-02-12 14:56:20,809 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:20,818 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0036_01_000003.tokens. Credentials list:
2015-02-12 14:56:20,818 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0036_01_000005.tokens. Credentials list:
2015-02-12 14:56:20,865 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:20,865 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:20,936 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:21,071 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:21,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:21,091 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:21,186 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000002/default_container_executor.sh]
2015-02-12 14:56:21,270 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0036_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000004.tokens
2015-02-12 14:56:21,271 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:21,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423780884992_0036_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000003.tokens
2015-02-12 14:56:21,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:21,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0036_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000005.tokens
2015-02-12 14:56:21,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:21,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:21,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:21,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:21,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:21,519 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:21,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:21,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:21,533 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:21,536 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000006 by user soberoi
2015-02-12 14:56:21,536 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000006
2015-02-12 14:56:21,537 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000006 to application application_1423780884992_0036
2015-02-12 14:56:21,537 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:56:21,537 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:21,537 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0036
2015-02-12 14:56:21,537 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:21,537 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0036
2015-02-12 14:56:21,538 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:21,597 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:21,597 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:21,606 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0036/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:21,610 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0036/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:21,610 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0036/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:21,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:21,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:21,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:21,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:21,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:21,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:21,706 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:21,706 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:21,707 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0036
2015-02-12 14:56:21,707 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:56:21,707 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0036_01_000007 on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@320da3d0
2015-02-12 14:56:21,745 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0036/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:21,745 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:21,749 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0036/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:21,749 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:21,766 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0036/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:21,766 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:21,797 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:21,798 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000008
2015-02-12 14:56:21,798 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:56:21,824 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:21,824 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:21,826 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:21,826 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:21,845 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:21,845 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:21,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000006/default_container_executor.sh]
2015-02-12 14:56:22,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000003/default_container_executor.sh]
2015-02-12 14:56:22,092 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000005/default_container_executor.sh]
2015-02-12 14:56:22,106 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000004/default_container_executor.sh]
2015-02-12 14:56:22,524 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:56:22,525 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:22,707 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0036_000001 on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096
2015-02-12 14:56:22,707 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0036 unreserved on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:56:23,363 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742221_1397
2015-02-12 14:56:23,498 INFO hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 14:56:23,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:56:23,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:56:23,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,509 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0031,submitTime=1423781633887,launchTime=1423781638768,firstMapTaskLaunchTime=1423781640971,firstReduceTaskLaunchTime=1423781654896,finishTime=1423781658224,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=56,reduceSlotSeconds=3,jobName=[672128F228ED4C28AA8F3FCB19B52DB7/4E33F33C634142BAABA432CE5CB7292C] lower*upper/(2/2)
2015-02-12 14:56:23,509 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0030,submitTime=1423781604135,launchTime=1423781608882,firstMapTaskLaunchTime=1423781611075,firstReduceTaskLaunchTime=1423781628965,finishTime=1423781632338,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=90,reduceSlotSeconds=3,jobName=[48A2D4029AC8491A91F5440CE69B5AB9/B20B162CA1A647689C2B8C5DFC99EACE] tail/(1/1) ...ipesplatform/renamedpipes
2015-02-12 14:56:23,509 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary]
2015-02-12 14:56:23,509 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary]
2015-02-12 14:56:23,509 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0032,submitTime=1423781659654,launchTime=1423781664039,firstMapTaskLaunchTime=1423781666323,firstReduceTaskLaunchTime=1423781683127,finishTime=1423781687329,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=88,reduceSlotSeconds=4,jobName=[672128F228ED4C28AA8F3FCB19B52DB7/4F4791B136CB464D8711C69CE1B9C27E] lower*upper/(1/2) ...orm/cogroupfilteredbranch
2015-02-12 14:56:23,509 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary]
2015-02-12 14:56:23,510 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742185_1361 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:56:23,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,511 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742163_1339 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:56:23,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,512 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742174_1350 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:56:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:56:23,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:56:23,514 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist
2015-02-12 14:56:23,514 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist
2015-02-12 14:56:23,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:56:23,514 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist
2015-02-12 14:56:23,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0032-1423781659654-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4F4791B136CB464D-1423781687329-6-1-SUCCEEDED-root.soberoi-1423781664039.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0030-1423781604135-soberoi-%5B48A2D4029AC8491A91F5440CE69B5AB9%2FB20B162CA1A64768-1423781632338-6-1-SUCCEEDED-root.soberoi-1423781608882.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,515 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0032_conf.xml
2015-02-12 14:56:23,515 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0030_conf.xml
2015-02-12 14:56:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0031-1423781633887-soberoi-%5B672128F228ED4C28AA8F3FCB19B52DB7%2F4E33F33C634142BA-1423781658224-5-1-SUCCEEDED-root.soberoi-1423781638768.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,516 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0031_conf.xml
2015-02-12 14:56:23,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0032_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0032_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0030_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0030_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0031_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0031_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,520 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0034,submitTime=1423781718357,launchTime=1423781722717,firstMapTaskLaunchTime=1423781724942,firstReduceTaskLaunchTime=1423781740839,finishTime=1423781744168,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=80,reduceSlotSeconds=3,jobName=[6C0F7388F5554468A9793E65F911CB83/7F745DC9B357406C8B20406C7EC552F0] lower*upper/(1/1) ...ldedpipesplatform/unknown
2015-02-12 14:56:23,520 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary]
2015-02-12 14:56:23,521 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0033,submitTime=1423781688926,launchTime=1423781694174,firstMapTaskLaunchTime=1423781696348,firstReduceTaskLaunchTime=1423781712276,finishTime=1423781716805,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=82,reduceSlotSeconds=4,jobName=[DDC314AFB5B4439B8D2198701C0D078D/87ECC34C350D4421BF99264BA5956A32] lower*upper/(1/1) ...ldedpipesplatform/cogroup
2015-02-12 14:56:23,521 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary]
2015-02-12 14:56:23,522 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423780884992_0035,submitTime=1423781745696,launchTime=1423781751286,firstMapTaskLaunchTime=1423781753423,firstReduceTaskLaunchTime=1423781768318,finishTime=1423781771827,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=60,reduceSlotSeconds=3,jobName=[1F7009B451D84D1CA3B2130302914513/F4EE99BDD37C406C855E33B2B64074F4] lower*upper/(1/1) ...orm/cogroupouterinnernull
2015-02-12 14:56:23,523 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary]
2015-02-12 14:56:23,523 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742207_1383 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:56:23,524 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742196_1372 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:56:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,524 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742218_1394 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:56:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033.summary dst=null perm=null proto=rpc
2015-02-12 14:56:23,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:56:23,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:56:23,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000 dst=null perm=null proto=rpc
2015-02-12 14:56:23,528 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:56:23,528 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:56:23,528 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000008
2015-02-12 14:56:23,528 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:56:23,528 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000008 on node: host: 10.1.1.67:50575 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:56:23,528 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist
2015-02-12 14:56:23,528 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist
2015-02-12 14:56:23,529 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist
2015-02-12 14:56:23,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0035-1423781745696-soberoi-%5B1F7009B451D84D1CA3B2130302914513%2FF4EE99BDD37C406C-1423781771827-5-1-SUCCEEDED-root.soberoi-1423781751286.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0033-1423781688926-soberoi-%5BDDC314AFB5B4439B8D2198701C0D078D%2F87ECC34C350D4421-1423781716805-6-1-SUCCEEDED-root.soberoi-1423781694174.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0034-1423781718357-soberoi-%5B6C0F7388F5554468A9793E65F911CB83%2F7F745DC9B357406C-1423781744168-6-1-SUCCEEDED-root.soberoi-1423781722717.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,532 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0033_conf.xml
2015-02-12 14:56:23,532 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0035_conf.xml
2015-02-12 14:56:23,532 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml to hdfs://localhost:50538/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0034_conf.xml
2015-02-12 14:56:23,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0034_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0034_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0033_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0033_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0035_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423780884992_0035_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:23,802 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0036_01_000008
2015-02-12 14:56:23,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/fail dst=null perm=null proto=rpc
2015-02-12 14:56:24,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402
2015-02-12 14:56:24,856 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401
2015-02-12 14:56:24,857 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402
2015-02-12 14:56:25,423 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742163_1339, blk_1073742196_1372, blk_1073742185_1361, blk_1073742218_1394, blk_1073742174_1350, blk_1073742207_1383]
2015-02-12 14:56:25,423 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742163_1339, blk_1073742196_1372, blk_1073742185_1361, blk_1073742218_1394, blk_1073742174_1350, blk_1073742207_1383]
2015-02-12 14:56:26,193 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742163 for deletion
2015-02-12 14:56:26,193 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742196 for deletion
2015-02-12 14:56:26,193 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742185_1361 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742185 for deletion
2015-02-12 14:56:26,193 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742218 for deletion
2015-02-12 14:56:26,193 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742174 for deletion
2015-02-12 14:56:26,194 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742207_1383 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742207 for deletion
2015-02-12 14:56:26,194 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742163
2015-02-12 14:56:26,193 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742196
2015-02-12 14:56:26,194 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742207_1383 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742207
2015-02-12 14:56:26,194 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742185_1361 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742185
2015-02-12 14:56:26,194 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742218
2015-02-12 14:56:26,195 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742174
2015-02-12 14:56:26,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742163 for deletion
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742196 for deletion
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742185_1361 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742185 for deletion
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742218 for deletion
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742163
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742218
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742196
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742174 for deletion
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742207_1383 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742207 for deletion
2015-02-12 14:56:26,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742185_1361 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742185
2015-02-12 14:56:26,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742174
2015-02-12 14:56:26,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742207_1383 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742207
2015-02-12 14:56:28,373 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401
2015-02-12 14:56:28,426 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742185_1361, blk_1073742218_1394, blk_1073742207_1383]
2015-02-12 14:56:28,426 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742163_1339, blk_1073742196_1372, blk_1073742174_1350]
2015-02-12 14:56:28,805 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742225_1401
2015-02-12 14:56:28,806 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742226_1402
2015-02-12 14:56:29,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742185_1361 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742185 for deletion
2015-02-12 14:56:29,250 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742218 for deletion
2015-02-12 14:56:29,250 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742207_1383 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742207 for deletion
2015-02-12 14:56:29,250 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742185_1361 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742185
2015-02-12 14:56:29,250 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742218
2015-02-12 14:56:29,250 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742207_1383 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742207
2015-02-12 14:56:29,829 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742163 for deletion
2015-02-12 14:56:29,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742196 for deletion
2015-02-12 14:56:29,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742174 for deletion
2015-02-12 14:56:29,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742163
2015-02-12 14:56:29,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742196
2015-02-12 14:56:29,830 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742174
2015-02-12 14:56:33,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:33,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:33,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:33,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:33,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:33,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:33,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:33,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:33,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:34,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:34,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:56:34,350 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:34,352 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000002
2015-02-12 14:56:34,352 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000002
2015-02-12 14:56:34,352 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:56:34,352 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000002
2015-02-12 14:56:34,397 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0036_01_000002 is : 143
2015-02-12 14:56:34,397 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:56:34,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403 src: /127.0.0.1:54886 dest: /127.0.0.1:50543
2015-02-12 14:56:34,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403 src: /127.0.0.1:54887 dest: /127.0.0.1:50539
2015-02-12 14:56:34,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403 src: /127.0.0.1:54888 dest: /127.0.0.1:50546
2015-02-12 14:56:34,415 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:34,415 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000002
2015-02-12 14:56:34,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000002
2015-02-12 14:56:34,416 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000002
2015-02-12 14:56:34,416 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:34,416 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000002 from application application_1423780884992_0036
2015-02-12 14:56:34,417 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:34,417 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:34,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000002
2015-02-12 14:56:34,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000002
2015-02-12 14:56:34,417 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist for DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:34,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:56:34,566 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:34,568 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000006
2015-02-12 14:56:34,568 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000006
2015-02-12 14:56:34,568 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:56:34,569 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:34,569 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:56:34,569 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000002
2015-02-12 14:56:34,569 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:56:34,569 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000002 on node: host: 10.1.1.67:50579 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:56:34,569 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000006
2015-02-12 14:56:34,597 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0036_01_000006 is : 143
2015-02-12 14:56:34,607 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:34,608 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000006
2015-02-12 14:56:34,608 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000006
2015-02-12 14:56:34,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000006
2015-02-12 14:56:34,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000006
2015-02-12 14:56:34,612 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000006
2015-02-12 14:56:34,612 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:34,613 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000006 from application application_1423780884992_0036
2015-02-12 14:56:34,613 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:34,614 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:34,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:56:34,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:56:34,830 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:34,831 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000005
2015-02-12 14:56:34,832 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000005
2015-02-12 14:56:34,832 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:56:34,832 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000005
2015-02-12 14:56:34,832 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:34,834 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000003
2015-02-12 14:56:34,834 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000003
2015-02-12 14:56:34,835 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:56:34,835 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000003
2015-02-12 14:56:34,858 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0036_01_000005 is : 143
2015-02-12 14:56:34,860 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0036_01_000003 is : 143
2015-02-12 14:56:34,870 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:34,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000005
2015-02-12 14:56:34,871 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:34,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000005
2015-02-12 14:56:34,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000005
2015-02-12 14:56:34,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000003
2015-02-12 14:56:34,872 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000005
2015-02-12 14:56:34,872 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:34,872 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000005 from application application_1423780884992_0036
2015-02-12 14:56:34,872 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:34,872 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:34,872 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000003
2015-02-12 14:56:34,872 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:34,872 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000003
2015-02-12 14:56:34,872 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000003
2015-02-12 14:56:34,873 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000003
2015-02-12 14:56:34,872 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000003 from application application_1423780884992_0036
2015-02-12 14:56:34,873 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:34,873 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:34,872 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000005
2015-02-12 14:56:34,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:56:34,930 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:34,932 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000004
2015-02-12 14:56:34,932 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000004
2015-02-12 14:56:34,932 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:56:34,932 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000004
2015-02-12 14:56:34,951 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0036_01_000004 is : 143
2015-02-12 14:56:34,960 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:34,961 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000004
2015-02-12 14:56:34,961 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000004
2015-02-12 14:56:34,962 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000004
2015-02-12 14:56:34,962 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000004
2015-02-12 14:56:34,962 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000004
2015-02-12 14:56:34,962 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:34,963 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000004 from application application_1423780884992_0036
2015-02-12 14:56:34,963 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:34,963 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:35,572 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:35,572 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:35,572 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:56:35,573 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000006
2015-02-12 14:56:35,573 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:56:35,573 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000006 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:56:35,837 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:35,837 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:56:35,837 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000003
2015-02-12 14:56:35,838 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:35,838 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:35,838 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:35,838 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000009
2015-02-12 14:56:35,838 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0036_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:35,839 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:35,839 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:56:35,839 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000005
2015-02-12 14:56:35,839 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:35,839 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000005 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:35,938 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:35,938 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:56:35,938 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000004
2015-02-12 14:56:35,938 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:35,938 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:36,574 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0036_01_000002]
2015-02-12 14:56:36,574 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:36,575 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:36,580 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:36,594 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:36,596 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0036_01_000009 by user soberoi
2015-02-12 14:56:36,597 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000009
2015-02-12 14:56:36,597 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0036_01_000009 to application application_1423780884992_0036
2015-02-12 14:56:36,597 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:56:36,597 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0036
2015-02-12 14:56:36,597 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0036
2015-02-12 14:56:36,597 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:36,598 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0036
2015-02-12 14:56:36,598 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:36,630 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:36,630 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:36,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000009/default_container_executor.sh]
2015-02-12 14:56:36,839 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:36,839 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:36,839 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:36,939 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:37,578 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0036_01_000006]
2015-02-12 14:56:37,578 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:37,587 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:56:37,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0036_01_000005]
2015-02-12 14:56:37,843 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:37,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0036_01_000003]
2015-02-12 14:56:37,843 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:37,942 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0036_01_000004]
2015-02-12 14:56:37,942 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:39,397 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:39,399 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:39,401 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:39,403 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:39,412 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:56:39,621 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:56:39,621 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:56:39,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:39,729 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:56:39,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404 src: /127.0.0.1:54909 dest: /127.0.0.1:50543
2015-02-12 14:56:39,824 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404 src: /127.0.0.1:54910 dest: /127.0.0.1:50546
2015-02-12 14:56:39,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404 src: /127.0.0.1:54911 dest: /127.0.0.1:50539
2015-02-12 14:56:39,864 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54911, dest: /127.0.0.1:50539, bytes: 170, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0036_r_000000_0_-348365316_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404, duration: 36954000
2015-02-12 14:56:39,865 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:39,865 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:56:39,865 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54910, dest: /127.0.0.1:50546, bytes: 170, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0036_r_000000_0_-348365316_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404, duration: 38014000
2015-02-12 14:56:39,866 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:39,867 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54909, dest: /127.0.0.1:50543, bytes: 170, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0036_r_000000_0_-348365316_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404, duration: 40077000
2015-02-12 14:56:39,868 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:39,869 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:56:39,870 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:39,874 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0036_r_000000_0_-348365316_1
2015-02-12 14:56:39,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:56:39,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:56:39,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/task_1423780884992_0036_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:56:39,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0036_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/task_1423780884992_0036_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:56:39,924 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:39,926 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000009
2015-02-12 14:56:39,927 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000009
2015-02-12 14:56:39,927 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:56:39,927 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000009
2015-02-12 14:56:39,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:39,942 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:39,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:56:39,955 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0036_01_000009 is : 143
2015-02-12 14:56:39,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:39,969 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:56:39,970 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000009
2015-02-12 14:56:39,970 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:56:39,970 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000009 from application application_1423780884992_0036
2015-02-12 14:56:39,971 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:39,971 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:39,971 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000009
2015-02-12 14:56:39,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:39,972 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000009
2015-02-12 14:56:39,972 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000009
2015-02-12 14:56:39,971 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000009
2015-02-12 14:56:39,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/task_1423780884992_0036_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:56:39,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:39,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary/1/task_1423780884992_0036_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:39,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:56:39,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:40,007 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:40,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:40,014 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:40,036 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54888, dest: /127.0.0.1:50546, bytes: 69203, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403, duration: 5628337000
2015-02-12 14:56:40,036 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:40,036 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16375
2015-02-12 14:56:40,038 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54887, dest: /127.0.0.1:50539, bytes: 69203, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403, duration: 5627089000
2015-02-12 14:56:40,038 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16375
2015-02-12 14:56:40,040 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54886, dest: /127.0.0.1:50543, bytes: 69203, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403, duration: 5632265000
2015-02-12 14:56:40,040 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742227_1403, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,041 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 16375
2015-02-12 14:56:40,043 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:40,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:40,049 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:56:40,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405 src: /127.0.0.1:54914 dest: /127.0.0.1:50539
2015-02-12 14:56:40,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405 src: /127.0.0.1:54915 dest: /127.0.0.1:50546
2015-02-12 14:56:40,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405 src: /127.0.0.1:54916 dest: /127.0.0.1:50543
2015-02-12 14:56:40,058 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54916, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405, duration: 2897000
2015-02-12 14:56:40,059 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:40,059 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,060 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54915, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405, duration: 3779000
2015-02-12 14:56:40,060 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,061 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54914, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405, duration: 5183000
2015-02-12 14:56:40,061 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,061 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,062 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,066 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:40,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:40,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:56:40,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:40,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:56:40,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:40,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:56:40,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:40,096 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:56:40,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406 src: /127.0.0.1:54918 dest: /127.0.0.1:50549
2015-02-12 14:56:40,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406 src: /127.0.0.1:54919 dest: /127.0.0.1:50546
2015-02-12 14:56:40,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406 src: /127.0.0.1:54920 dest: /127.0.0.1:50539
2015-02-12 14:56:40,110 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54920, dest: /127.0.0.1:50539, bytes: 69203, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406, duration: 4004000
2015-02-12 14:56:40,110 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:40,111 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,111 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54919, dest: /127.0.0.1:50546, bytes: 69203, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406, duration: 4754000
2015-02-12 14:56:40,111 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,111 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,112 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54918, dest: /127.0.0.1:50549, bytes: 69203, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406, duration: 5642000
2015-02-12 14:56:40,112 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,112 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,114 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:40,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:40,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:56:40,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:40,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:56:40,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:56:40,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036/job_1423780884992_0036_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:56:40,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:40,136 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:56:40,138 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407 src: /127.0.0.1:54922 dest: /127.0.0.1:50546
2015-02-12 14:56:40,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407 src: /127.0.0.1:54923 dest: /127.0.0.1:50543
2015-02-12 14:56:40,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407 src: /127.0.0.1:54924 dest: /127.0.0.1:50539
2015-02-12 14:56:40,144 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54924, dest: /127.0.0.1:50539, bytes: 115088, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407, duration: 2019000
2015-02-12 14:56:40,144 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:40,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,145 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54923, dest: /127.0.0.1:50543, bytes: 115088, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407, duration: 2476000
2015-02-12 14:56:40,145 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,146 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54922, dest: /127.0.0.1:50546, bytes: 115088, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2108295417_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407, duration: 3875000
2015-02-12 14:56:40,146 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:40,147 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:40,148 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2108295417_1
2015-02-12 14:56:40,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:40,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:40,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:40,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0036-1423781773358-soberoi-%5BAE5E21E5972E430EAAE05F15CF6F121F%2F0BEBD16FC5654A42-1423781800016-5-1-SUCCEEDED-root.soberoi-1423781778503.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:56:40,172 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0036_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:56:40,172 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:56:40,172 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0036 with final state: FINISHING
2015-02-12 14:56:40,172 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from RUNNING to FINAL_SAVING
2015-02-12 14:56:40,172 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:56:40,172 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0036
2015-02-12 14:56:40,173 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from FINAL_SAVING to FINISHING
2015-02-12 14:56:40,928 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:40,929 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:56:40,929 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000009
2015-02-12 14:56:40,929 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:56:40,929 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000009 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:56:41,177 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0036 unregistered successfully.
2015-02-12 14:56:41,181 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742221_1397 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:56:41,181 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742222_1398 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:56:41,181 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742223_1399 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:56:41,181 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742224_1400 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50549
2015-02-12 14:56:41,181 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742226_1402 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:56:41,182 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742227_1403 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:56:41,182 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742225_1401 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:56:41,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0036 dst=null perm=null proto=rpc
2015-02-12 14:56:41,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,217 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary
2015-02-12 14:56:41,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:56:41,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,249 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:41,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:41,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,268 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:41,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:41,272 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup
2015-02-12 14:56:41,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:56:41,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:41,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:41,278 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull
2015-02-12 14:56:41,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:41,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:41,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:41,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:41,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:41,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupouterinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:56:41,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,302 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:56:41,302 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:56:41,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull"]
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:56:41,315 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:56:41,317 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...platform/cogroupinnernull
2015-02-12 14:56:41,329 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:56:41,343 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:56:41,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:56:41,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:56:41,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:56:41,350 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 37
2015-02-12 14:56:41,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037 dst=null perm=null proto=rpc
2015-02-12 14:56:41,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:56:41,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:56:41,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,360 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:56:41,364 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 src: /127.0.0.1:54930 dest: /127.0.0.1:50539
2015-02-12 14:56:41,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 src: /127.0.0.1:54931 dest: /127.0.0.1:50543
2015-02-12 14:56:41,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 src: /127.0.0.1:54932 dest: /127.0.0.1:50549
2015-02-12 14:56:41,372 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54932, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408, duration: 2276000
2015-02-12 14:56:41,372 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:41,373 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:56:41,373 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54931, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408, duration: 3422000
2015-02-12 14:56:41,374 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,374 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:56:41,375 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54930, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408, duration: 4726000
2015-02-12 14:56:41,375 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,385 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:56:41,387 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:41,388 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar
2015-02-12 14:56:41,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:56:41,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:56:41,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:56:41,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:56:41,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:56:41,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,397 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:41,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,400 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:41,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,405 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:41,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,407 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:56:41,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:41,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,415 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split
2015-02-12 14:56:41,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:41,417 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:56:41,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409 src: /127.0.0.1:54933 dest: /127.0.0.1:50546
2015-02-12 14:56:41,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409 src: /127.0.0.1:54934 dest: /127.0.0.1:50543
2015-02-12 14:56:41,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409 src: /127.0.0.1:54935 dest: /127.0.0.1:50539
2015-02-12 14:56:41,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409 src: /127.0.0.1:54936 dest: /127.0.0.1:50549
2015-02-12 14:56:41,428 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54936, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, duration: 1426000
2015-02-12 14:56:41,428 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:41,429 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54935, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, duration: 2270000
2015-02-12 14:56:41,429 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,430 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,432 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54934, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, duration: 4545000
2015-02-12 14:56:41,432 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,434 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54933, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, duration: 6525000
2015-02-12 14:56:41,434 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,434 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,436 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,437 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,439 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:41,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,443 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:56:41,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410 src: /127.0.0.1:54937 dest: /127.0.0.1:50549
2015-02-12 14:56:41,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410 src: /127.0.0.1:54938 dest: /127.0.0.1:50539
2015-02-12 14:56:41,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410 src: /127.0.0.1:54939 dest: /127.0.0.1:50546
2015-02-12 14:56:41,450 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54939, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410, duration: 1180000
2015-02-12 14:56:41,450 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:41,451 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:56:41,451 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54938, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410, duration: 1547000
2015-02-12 14:56:41,451 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,451 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:56:41,452 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54937, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410, duration: 2487000
2015-02-12 14:56:41,452 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,453 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,454 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:41,454 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:56:41,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:56:41,464 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:56:41,467 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411 src: /127.0.0.1:54940 dest: /127.0.0.1:50549
2015-02-12 14:56:41,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411 src: /127.0.0.1:54941 dest: /127.0.0.1:50546
2015-02-12 14:56:41,472 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411 src: /127.0.0.1:54942 dest: /127.0.0.1:50543
2015-02-12 14:56:41,475 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54942, dest: /127.0.0.1:50543, bytes: 98352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411, duration: 1758000
2015-02-12 14:56:41,476 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:41,476 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,476 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54941, dest: /127.0.0.1:50546, bytes: 98352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411, duration: 2271000
2015-02-12 14:56:41,477 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,478 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,480 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54940, dest: /127.0.0.1:50549, bytes: 98352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411, duration: 5657000
2015-02-12 14:56:41,480 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:41,484 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:41,485 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:56:41,485 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0037
2015-02-12 14:56:41,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037 dst=null perm=null proto=rpc
2015-02-12 14:56:41,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:41,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:41,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:41,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:41,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:41,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:41,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,505 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 37 submitted by user soberoi
2015-02-12 14:56:41,505 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0037
2015-02-12 14:56:41,506 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from NEW to NEW_SAVING
2015-02-12 14:56:41,505 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0037
2015-02-12 14:56:41,506 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0037
2015-02-12 14:56:41,506 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:56:41,506 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0037 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:56:41,508 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from SUBMITTED to ACCEPTED
2015-02-12 14:56:41,508 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0037
2015-02-12 14:56:41,508 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0037_000001
2015-02-12 14:56:41,509 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from NEW to SUBMITTED
2015-02-12 14:56:41,509 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0037_000001 to scheduler from user: soberoi
2015-02-12 14:56:41,509 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:56:41,511 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0037/
2015-02-12 14:56:41,512 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0037
2015-02-12 14:56:41,512 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0037/
2015-02-12 14:56:41,593 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:41,593 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000001
2015-02-12 14:56:41,593 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:56:41,593 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0037_01_000001
2015-02-12 14:56:41,594 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:41,594 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0037_000001
2015-02-12 14:56:41,594 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0037 AttemptId: appattempt_1423780884992_0037_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0037_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:56:41,594 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:56:41,595 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:56:41,595 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0037_000001
2015-02-12 14:56:41,596 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0037_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0037_000001
2015-02-12 14:56:41,596 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0037_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:56:41,596 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0037_000001
2015-02-12 14:56:41,596 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0037_000001
2015-02-12 14:56:41,598 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:41,600 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000001 by user soberoi
2015-02-12 14:56:41,600 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0037
2015-02-12 14:56:41,601 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000001
2015-02-12 14:56:41,601 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from NEW to INITING
2015-02-12 14:56:41,601 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000001 to application application_1423780884992_0037
2015-02-12 14:56:41,601 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from INITING to RUNNING
2015-02-12 14:56:41,601 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0037_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0037_000001
2015-02-12 14:56:41,601 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:56:41,601 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:56:41,602 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:41,602 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:56:41,602 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:56:41,602 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:56:41,602 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:41,602 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0037_01_000001
2015-02-12 14:56:41,614 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0037_01_000001.tokens. Credentials list:
2015-02-12 14:56:41,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:41,811 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423780884992_0037_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000001.tokens
2015-02-12 14:56:41,811 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:56:41,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:41,932 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:41,949 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:41,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:41,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:42,022 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0037/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:42,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:42,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:42,101 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0037/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:42,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:42,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:42,172 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0037/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:42,172 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:42,211 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:42,211 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:42,326 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000001/default_container_executor.sh]
2015-02-12 14:56:42,594 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:42,933 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:43,437 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50549 to replicate blk_1073742232_1408 to datanode(s) 127.0.0.1:50546
2015-02-12 14:56:43,438 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742226_1402, blk_1073742221_1397, blk_1073742222_1398, blk_1073742223_1399]
2015-02-12 14:56:43,438 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742226_1402, blk_1073742227_1403, blk_1073742221_1397, blk_1073742222_1398, blk_1073742223_1399]
2015-02-12 14:56:43,939 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:44,208 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742224 for deletion
2015-02-12 14:56:44,208 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742225 for deletion
2015-02-12 14:56:44,208 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742226 for deletion
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742227 for deletion
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742224
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742225
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221 for deletion
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222 for deletion
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742223 for deletion
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742226
2015-02-12 14:56:44,209 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742227
2015-02-12 14:56:44,210 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222
2015-02-12 14:56:44,210 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221
2015-02-12 14:56:44,210 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742223
2015-02-12 14:56:44,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:56:44,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:56:44,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:56:44,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:56:44,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037 dst=null perm=null proto=rpc
2015-02-12 14:56:44,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:56:44,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:56:44,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:44,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:56:44,841 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=6b984cb2-71ab-460a-8cc1-517caf617de4, infoPort=50550, ipcPort=50551, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 to 127.0.0.1:50546
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742224 for deletion
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742225 for deletion
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742226 for deletion
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221 for deletion
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742224
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222 for deletion
2015-02-12 14:56:44,842 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742223 for deletion
2015-02-12 14:56:44,843 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 (numBytes=254067) to /127.0.0.1:50546
2015-02-12 14:56:44,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742226
2015-02-12 14:56:44,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742225
2015-02-12 14:56:44,844 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222
2015-02-12 14:56:44,844 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221
2015-02-12 14:56:44,844 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 src: /127.0.0.1:54949 dest: /127.0.0.1:50546
2015-02-12 14:56:44,844 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742223
2015-02-12 14:56:44,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408 src: /127.0.0.1:54949 dest: /127.0.0.1:50546 of size 254067
2015-02-12 14:56:44,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742232_1408 size 254067
2015-02-12 14:56:44,939 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:45,802 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:45,804 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0037_000001
2015-02-12 14:56:45,805 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0037 APPATTEMPTID=appattempt_1423780884992_0037_000001
2015-02-12 14:56:45,805 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:56:45,805 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from ACCEPTED to RUNNING
2015-02-12 14:56:45,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:45,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:56:45,940 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:46,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:46,232 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0036_01_000001 succeeded
2015-02-12 14:56:46,232 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:56:46,233 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0036_01_000001
2015-02-12 14:56:46,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000001
2015-02-12 14:56:46,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000001
2015-02-12 14:56:46,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000001
2015-02-12 14:56:46,256 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000001
2015-02-12 14:56:46,256 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0036_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:56:46,256 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0036_01_000001 from application application_1423780884992_0036
2015-02-12 14:56:46,256 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:46,256 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0036
2015-02-12 14:56:46,256 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036/container_1423780884992_0036_01_000001
2015-02-12 14:56:46,386 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:56:46,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412 src: /127.0.0.1:54957 dest: /127.0.0.1:50539
2015-02-12 14:56:46,437 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412 src: /127.0.0.1:54958 dest: /127.0.0.1:50546
2015-02-12 14:56:46,438 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412 src: /127.0.0.1:54959 dest: /127.0.0.1:50543
2015-02-12 14:56:46,442 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742224_1400, blk_1073742226_1402, blk_1073742227_1403, blk_1073742221_1397, blk_1073742222_1398]
2015-02-12 14:56:46,442 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742225_1401, blk_1073742227_1403, blk_1073742221_1397, blk_1073742222_1398, blk_1073742223_1399]
2015-02-12 14:56:46,483 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54959, dest: /127.0.0.1:50543, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412, duration: 43059000
2015-02-12 14:56:46,484 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:46,484 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:46,484 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54958, dest: /127.0.0.1:50546, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412, duration: 43662000
2015-02-12 14:56:46,485 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:46,485 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54957, dest: /127.0.0.1:50539, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412, duration: 44843000
2015-02-12 14:56:46,486 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:46,486 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:46,487 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:46,492 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1_conf.xml is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:56:46,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:56:46,529 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:56:46,531 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413 src: /127.0.0.1:54960 dest: /127.0.0.1:50543
2015-02-12 14:56:46,533 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413 src: /127.0.0.1:54961 dest: /127.0.0.1:50546
2015-02-12 14:56:46,534 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413 src: /127.0.0.1:54962 dest: /127.0.0.1:50539
2015-02-12 14:56:46,539 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54962, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413, duration: 2064000
2015-02-12 14:56:46,539 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:56:46,539 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:46,539 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54961, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413, duration: 2267000
2015-02-12 14:56:46,540 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:46,540 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:54960, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413, duration: 3431000
2015-02-12 14:56:46,541 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:46,541 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:56:46,542 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:56:46,545 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037.summary is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:56:46,607 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0036_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:56:46,607 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0036_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:56:46,607 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0036_000001
2015-02-12 14:56:46,608 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0036_000001
2015-02-12 14:56:46,607 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000001
2015-02-12 14:56:46,608 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0036_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:56:46,608 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0036_000001 released container container_1423780884992_0036_01_000001 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:56:46,608 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0036_000001 State change from FINISHING to FINISHED
2015-02-12 14:56:46,608 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0036 State change from FINISHING to FINISHED
2015-02-12 14:56:46,608 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0036_000001 is done. finalState=FINISHED
2015-02-12 14:56:46,608 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0036
2015-02-12 14:56:46,608 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0036_000001
2015-02-12 14:56:46,608 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0036 requests cleared
2015-02-12 14:56:46,608 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0036,name=[AE5E21E5972E430EAAE05F15CF6F121F/0BEBD16FC5654A42980CBFC1151A2DD2] lower*upper/(1/1) ...uterinnernull-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0036/jobhistory/job/job_1423780884992_0036,appMasterHost=10.1.1.67,startTime=1423781773358,finishTime=1423781800172,finalStatus=SUCCEEDED
2015-02-12 14:56:46,611 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0036_000001 (auth:SIMPLE)
2015-02-12 14:56:46,612 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0036_01_000001
2015-02-12 14:56:46,613 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0036 CONTAINERID=container_1423780884992_0036_01_000001
2015-02-12 14:56:46,613 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0036_01_000001]
2015-02-12 14:56:46,613 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:46,613 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:46,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,615 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0036
2015-02-12 14:56:46,615 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,615 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:46,615 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0036, with delay of 10800 seconds
2015-02-12 14:56:46,867 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:46,867 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:46,867 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000002
2015-02-12 14:56:46,867 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:46,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,868 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0036
2015-02-12 14:56:46,868 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:46,868 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0036, with delay of 10800 seconds
2015-02-12 14:56:46,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,944 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:46,944 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:46,945 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:46,945 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000003
2015-02-12 14:56:46,946 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:46,946 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,946 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0036
2015-02-12 14:56:46,946 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,947 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,946 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:46,947 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0036, with delay of 10800 seconds
2015-02-12 14:56:46,947 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,974 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:46,974 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000004
2015-02-12 14:56:46,975 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:56:46,975 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:56:46,976 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0036
2015-02-12 14:56:46,977 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:56:46,977 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0036, with delay of 10800 seconds
2015-02-12 14:56:46,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,978 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:46,978 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0036
2015-02-12 14:56:47,265 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742225 for deletion
2015-02-12 14:56:47,265 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742227 for deletion
2015-02-12 14:56:47,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221 for deletion
2015-02-12 14:56:47,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222 for deletion
2015-02-12 14:56:47,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742225
2015-02-12 14:56:47,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742223 for deletion
2015-02-12 14:56:47,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742227
2015-02-12 14:56:47,267 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221
2015-02-12 14:56:47,267 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222
2015-02-12 14:56:47,267 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742223
2015-02-12 14:56:47,580 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742224 for deletion
2015-02-12 14:56:47,580 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742226 for deletion
2015-02-12 14:56:47,580 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742227 for deletion
2015-02-12 14:56:47,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221 for deletion
2015-02-12 14:56:47,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742224
2015-02-12 14:56:47,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222 for deletion
2015-02-12 14:56:47,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742227
2015-02-12 14:56:47,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742226
2015-02-12 14:56:47,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742221_1397 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742221
2015-02-12 14:56:47,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742222_1398 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742222
2015-02-12 14:56:47,617 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:47,617 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000005
2015-02-12 14:56:47,618 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:56:47,855 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0037_01_000002
2015-02-12 14:56:47,855 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:47,855 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0037_01_000003
2015-02-12 14:56:47,855 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:47,856 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0037_01_000004
2015-02-12 14:56:47,856 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:47,856 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0037_01_000005
2015-02-12 14:56:47,856 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:47,871 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:47,871 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000006
2015-02-12 14:56:47,871 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:56:47,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:47,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:47,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:56:47,948 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:56:48,005 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:48,008 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:48,016 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:48,023 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:48,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000002 by user soberoi
2015-02-12 14:56:48,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000004 by user soberoi
2015-02-12 14:56:48,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0037
2015-02-12 14:56:48,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0037
2015-02-12 14:56:48,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000004
2015-02-12 14:56:48,026 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from NEW to INITING
2015-02-12 14:56:48,026 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from NEW to INITING
2015-02-12 14:56:48,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000003 by user soberoi
2015-02-12 14:56:48,026 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0037
2015-02-12 14:56:48,026 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000004 to application application_1423780884992_0037
2015-02-12 14:56:48,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000003
2015-02-12 14:56:48,026 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from INITING to RUNNING
2015-02-12 14:56:48,027 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from NEW to INITING
2015-02-12 14:56:48,027 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:56:48,026 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000002 to application application_1423780884992_0037
2015-02-12 14:56:48,027 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from INITING to RUNNING
2015-02-12 14:56:48,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000002
2015-02-12 14:56:48,027 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,027 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,027 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:48,028 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0037
2015-02-12 14:56:48,028 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:48,027 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000003 to application application_1423780884992_0037
2015-02-12 14:56:48,028 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:48,028 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from INITING to RUNNING
2015-02-12 14:56:48,028 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0037_01_000004
2015-02-12 14:56:48,027 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:56:48,028 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,029 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,029 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:48,028 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:56:48,029 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,029 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0037
2015-02-12 14:56:48,029 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:48,029 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:48,029 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,029 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0037_01_000002
2015-02-12 14:56:48,029 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:48,030 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0037
2015-02-12 14:56:48,030 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:56:48,030 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:56:48,030 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0037_01_000003
2015-02-12 14:56:48,033 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000005 by user soberoi
2015-02-12 14:56:48,033 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000005
2015-02-12 14:56:48,034 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000005 to application application_1423780884992_0037
2015-02-12 14:56:48,034 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:56:48,034 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,034 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,034 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:48,034 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0037
2015-02-12 14:56:48,035 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:48,055 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0037_01_000004.tokens. Credentials list:
2015-02-12 14:56:48,056 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0037_01_000003.tokens. Credentials list:
2015-02-12 14:56:48,060 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0037_01_000002.tokens. Credentials list:
2015-02-12 14:56:48,107 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:48,107 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:48,390 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407
2015-02-12 14:56:48,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404
2015-02-12 14:56:48,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410
2015-02-12 14:56:48,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409
2015-02-12 14:56:48,392 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405
2015-02-12 14:56:48,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:48,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:48,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:48,550 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000005/default_container_executor.sh]
2015-02-12 14:56:48,593 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408
2015-02-12 14:56:48,594 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406
2015-02-12 14:56:48,620 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:48,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0037_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000003.tokens
2015-02-12 14:56:48,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:56:48,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423780884992_0037_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000004.tokens
2015-02-12 14:56:48,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:56:48,646 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0037_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000002.tokens
2015-02-12 14:56:48,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:56:48,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:48,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:48,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:48,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:48,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:48,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar dst=null perm=null proto=rpc
2015-02-12 14:56:48,867 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:48,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:48,875 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:56:48,875 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000007
2015-02-12 14:56:48,875 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:56:48,878 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:56:48,882 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000006 by user soberoi
2015-02-12 14:56:48,882 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000006
2015-02-12 14:56:48,883 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000006 to application application_1423780884992_0037
2015-02-12 14:56:48,883 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:56:48,883 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,883 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0037
2015-02-12 14:56:48,883 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:56:48,883 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0037
2015-02-12 14:56:48,884 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0037_01_000006
2015-02-12 14:56:48,914 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0037_01_000006.tokens. Credentials list:
2015-02-12 14:56:48,949 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:48,960 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0037/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:48,962 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0037/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:48,968 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0037/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:48,976 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:49,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:49,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:49,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:49,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:49,028 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408
2015-02-12 14:56:49,028 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404
2015-02-12 14:56:49,029 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409
2015-02-12 14:56:49,029 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405
2015-02-12 14:56:49,030 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407
2015-02-12 14:56:49,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:49,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml dst=null perm=null proto=rpc
2015-02-12 14:56:49,134 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0037/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:49,134 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:49,135 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:49,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0037/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:49,148 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:49,150 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0037/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:56:49,174 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:56:49,228 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411
2015-02-12 14:56:49,253 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:49,253 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:49,274 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:49,274 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:49,291 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:49,291 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:49,299 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:56:49,299 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:56:49,553 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000002/default_container_executor.sh]
2015-02-12 14:56:49,563 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000006/default_container_executor.sh]
2015-02-12 14:56:49,564 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000004/default_container_executor.sh]
2015-02-12 14:56:49,571 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000003/default_container_executor.sh]
2015-02-12 14:56:49,652 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406
2015-02-12 14:56:49,653 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742229_1405
2015-02-12 14:56:49,653 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742231_1407
2015-02-12 14:56:49,858 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411
2015-02-12 14:56:49,859 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409
2015-02-12 14:56:49,860 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742228_1404
2015-02-12 14:56:49,860 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410
2015-02-12 14:56:49,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:56:49,874 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:56:49,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:56:49,877 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742233_1409
2015-02-12 14:56:49,878 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742230_1406
2015-02-12 14:56:49,881 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408
2015-02-12 14:56:49,882 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742234_1410
2015-02-12 14:56:50,083 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742235_1411
2015-02-12 14:56:50,172 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:56:50,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423780884992_0037_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000006.tokens
2015-02-12 14:56:50,331 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:56:50,880 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:56:50,880 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000007 in state: RELEASED event:RELEASED
2015-02-12 14:56:50,880 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000007
2015-02-12 14:56:50,880 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:56:50,880 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000007 on node: host: 10.1.1.67:50571 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:56:51,880 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0037_01_000007
2015-02-12 14:56:53,599 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412
2015-02-12 14:56:53,599 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413
2015-02-12 14:56:54,235 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412
2015-02-12 14:56:54,236 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413
2015-02-12 14:56:54,866 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742232_1408
2015-02-12 14:56:54,867 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742236_1412
2015-02-12 14:56:54,868 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742237_1413
2015-02-12 14:56:59,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:59,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:59,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:59,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:59,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job.split dst=null perm=null proto=rpc
2015-02-12 14:56:59,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:59,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:59,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:59,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:56:59,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:00,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:57:00,112 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:00,113 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000005
2015-02-12 14:57:00,114 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000005
2015-02-12 14:57:00,114 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:57:00,114 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000005
2015-02-12 14:57:00,134 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0037_01_000005 is : 143
2015-02-12 14:57:00,137 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:57:00,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414 src: /127.0.0.1:55016 dest: /127.0.0.1:50549
2015-02-12 14:57:00,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414 src: /127.0.0.1:55017 dest: /127.0.0.1:50539
2015-02-12 14:57:00,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414 src: /127.0.0.1:55018 dest: /127.0.0.1:50543
2015-02-12 14:57:00,153 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:00,153 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000005
2015-02-12 14:57:00,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000005
2015-02-12 14:57:00,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000005
2015-02-12 14:57:00,158 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000005
2015-02-12 14:57:00,158 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:00,158 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000005 from application application_1423780884992_0037
2015-02-12 14:57:00,158 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:00,159 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:00,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000005
2015-02-12 14:57:00,160 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist for DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:00,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:57:00,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:00,338 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:00,340 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000006
2015-02-12 14:57:00,341 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000006
2015-02-12 14:57:00,341 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:57:00,341 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000006
2015-02-12 14:57:00,366 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0037_01_000006 is : 143
2015-02-12 14:57:00,401 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:00,401 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:00,403 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000006
2015-02-12 14:57:00,403 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:00,403 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000006 from application application_1423780884992_0037
2015-02-12 14:57:00,403 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:00,403 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:00,403 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000006
2015-02-12 14:57:00,404 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000006
2015-02-12 14:57:00,404 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000006
2015-02-12 14:57:00,404 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000006
2015-02-12 14:57:00,406 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000002
2015-02-12 14:57:00,406 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000002
2015-02-12 14:57:00,407 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:57:00,407 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000002
2015-02-12 14:57:00,408 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:00,408 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:57:00,408 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000006
2015-02-12 14:57:00,408 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:57:00,408 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:57:00,425 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0037_01_000002 is : 143
2015-02-12 14:57:00,439 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:00,439 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000002
2015-02-12 14:57:00,440 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000002
2015-02-12 14:57:00,441 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000002
2015-02-12 14:57:00,442 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000002
2015-02-12 14:57:00,444 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000002
2015-02-12 14:57:00,445 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:00,445 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000002 from application application_1423780884992_0037
2015-02-12 14:57:00,445 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:00,446 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:00,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:57:00,488 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:00,491 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000004
2015-02-12 14:57:00,491 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000004
2015-02-12 14:57:00,491 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:57:00,492 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000004
2015-02-12 14:57:00,515 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0037_01_000004 is : 143
2015-02-12 14:57:00,524 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:00,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000004
2015-02-12 14:57:00,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000004
2015-02-12 14:57:00,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000004
2015-02-12 14:57:00,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000004
2015-02-12 14:57:00,526 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000004
2015-02-12 14:57:00,528 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:00,528 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000004 from application application_1423780884992_0037
2015-02-12 14:57:00,528 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:00,528 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:00,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:57:00,595 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:00,596 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000003
2015-02-12 14:57:00,597 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000003
2015-02-12 14:57:00,597 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:57:00,597 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000003
2015-02-12 14:57:00,621 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0037_01_000003 is : 143
2015-02-12 14:57:00,627 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:00,628 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000003
2015-02-12 14:57:00,629 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000003
2015-02-12 14:57:00,630 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:00,630 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000003 from application application_1423780884992_0037
2015-02-12 14:57:00,631 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:00,631 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:00,632 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000003
2015-02-12 14:57:00,630 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000003
2015-02-12 14:57:00,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000003
2015-02-12 14:57:01,118 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:01,118 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:57:01,118 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000005
2015-02-12 14:57:01,119 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:57:01,119 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000005 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:57:01,408 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:01,408 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:57:01,409 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000002
2015-02-12 14:57:01,409 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:01,409 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000002 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:01,409 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:01,497 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:01,497 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:57:01,497 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000004
2015-02-12 14:57:01,497 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:01,498 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:01,601 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:01,601 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:57:01,602 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000003
2015-02-12 14:57:01,602 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:01,602 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000003 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:02,123 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:02,123 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:02,123 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000008
2015-02-12 14:57:02,124 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0037_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:57:02,409 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0037_01_000006]
2015-02-12 14:57:02,409 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:02,409 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:02,498 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:02,604 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:02,933 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:02,943 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:02,945 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0037_01_000008 by user soberoi
2015-02-12 14:57:02,945 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000008
2015-02-12 14:57:02,945 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0037_01_000008 to application application_1423780884992_0037
2015-02-12 14:57:02,946 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 14:57:02,946 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0037
2015-02-12 14:57:02,946 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0037
2015-02-12 14:57:02,946 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:02,946 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0037
2015-02-12 14:57:02,947 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:02,978 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:02,978 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:03,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000008/default_container_executor.sh]
2015-02-12 14:57:03,128 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0037_01_000005]
2015-02-12 14:57:03,128 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:03,129 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:03,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0037_01_000002]
2015-02-12 14:57:03,410 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:03,501 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0037_01_000004]
2015-02-12 14:57:03,501 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:03,608 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0037_01_000003]
2015-02-12 14:57:03,608 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:03,938 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:57:05,588 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:05,591 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:05,594 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:05,596 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:05,604 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:05,840 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 3311 Total time for transactions(ms): 264 Number of transactions batched in Syncs: 10 Number of syncs: 2302 SyncTimes(ms): 782 546
2015-02-12 14:57:05,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:05,911 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:06,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415 src: /127.0.0.1:55031 dest: /127.0.0.1:50549
2015-02-12 14:57:06,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415 src: /127.0.0.1:55032 dest: /127.0.0.1:50539
2015-02-12 14:57:06,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415 src: /127.0.0.1:55033 dest: /127.0.0.1:50546
2015-02-12 14:57:06,080 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55033, dest: /127.0.0.1:50546, bytes: 150, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0037_r_000000_0_1170369594_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415, duration: 44152000
2015-02-12 14:57:06,080 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:06,081 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,081 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55032, dest: /127.0.0.1:50539, bytes: 150, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0037_r_000000_0_1170369594_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415, duration: 44729000
2015-02-12 14:57:06,081 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,083 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55031, dest: /127.0.0.1:50549, bytes: 150, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0037_r_000000_0_1170369594_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415, duration: 46143000
2015-02-12 14:57:06,083 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,085 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,096 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0037_r_000000_0_1170369594_1
2015-02-12 14:57:06,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:06,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:06,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/task_1423780884992_0037_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:57:06,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/_temporary/attempt_1423780884992_0037_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/task_1423780884992_0037_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:57:06,145 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:06,148 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000008
2015-02-12 14:57:06,148 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000008
2015-02-12 14:57:06,148 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000008 transitioned from RUNNING to KILLING
2015-02-12 14:57:06,148 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000008
2015-02-12 14:57:06,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,163 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:57:06,173 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0037_01_000008 is : 143
2015-02-12 14:57:06,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:06,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:06,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/task_1423780884992_0037_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:57:06,186 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:06,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:06,187 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000008
2015-02-12 14:57:06,187 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:06,187 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000008 from application application_1423780884992_0037
2015-02-12 14:57:06,187 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:06,187 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:06,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000008
2015-02-12 14:57:06,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000008
2015-02-12 14:57:06,189 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000008
2015-02-12 14:57:06,189 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000008
2015-02-12 14:57:06,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary/1/task_1423780884992_0037_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:57:06,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,203 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_SUCCESS is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,208 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,225 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55018, dest: /127.0.0.1:50543, bytes: 69210, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414, duration: 6077306000
2015-02-12 14:57:06,225 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:06,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16373
2015-02-12 14:57:06,227 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55017, dest: /127.0.0.1:50539, bytes: 69210, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414, duration: 6076812000
2015-02-12 14:57:06,227 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,230 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16373
2015-02-12 14:57:06,231 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55016, dest: /127.0.0.1:50549, bytes: 69210, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414, duration: 6078761000
2015-02-12 14:57:06,235 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742238_1414, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 16373
2015-02-12 14:57:06,238 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,246 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:57:06,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416 src: /127.0.0.1:55035 dest: /127.0.0.1:50539
2015-02-12 14:57:06,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416 src: /127.0.0.1:55036 dest: /127.0.0.1:50546
2015-02-12 14:57:06,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416 src: /127.0.0.1:55037 dest: /127.0.0.1:50543
2015-02-12 14:57:06,254 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55037, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416, duration: 1357000
2015-02-12 14:57:06,254 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:06,255 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55036, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416, duration: 2138000
2015-02-12 14:57:06,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,255 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,256 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55035, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416, duration: 3077000
2015-02-12 14:57:06,256 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,259 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037.summary_tmp is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:06,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:06,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:06,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:06,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:06,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:06,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,295 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:06,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417 src: /127.0.0.1:55039 dest: /127.0.0.1:50546
2015-02-12 14:57:06,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417 src: /127.0.0.1:55040 dest: /127.0.0.1:50549
2015-02-12 14:57:06,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417 src: /127.0.0.1:55041 dest: /127.0.0.1:50539
2015-02-12 14:57:06,306 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55041, dest: /127.0.0.1:50539, bytes: 69210, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417, duration: 2545000
2015-02-12 14:57:06,307 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:06,308 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55040, dest: /127.0.0.1:50549, bytes: 69210, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417, duration: 3363000
2015-02-12 14:57:06,308 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,308 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,309 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,309 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55039, dest: /127.0.0.1:50546, bytes: 69210, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417, duration: 4923000
2015-02-12 14:57:06,310 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,310 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,313 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:06,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:06,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:06,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:06,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:06,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037/job_1423780884992_0037_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:06,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:06,334 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:06,338 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418 src: /127.0.0.1:55043 dest: /127.0.0.1:50549
2015-02-12 14:57:06,339 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418 src: /127.0.0.1:55044 dest: /127.0.0.1:50543
2015-02-12 14:57:06,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418 src: /127.0.0.1:55045 dest: /127.0.0.1:50546
2015-02-12 14:57:06,347 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55045, dest: /127.0.0.1:50546, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418, duration: 2970000
2015-02-12 14:57:06,347 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:06,348 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:57:06,348 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55044, dest: /127.0.0.1:50543, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418, duration: 3631000
2015-02-12 14:57:06,348 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,349 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55043, dest: /127.0.0.1:50549, bytes: 115067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_880515029_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418, duration: 4769000
2015-02-12 14:57:06,349 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,349 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:06,350 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:06,353 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_880515029_1
2015-02-12 14:57:06,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:06,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:06,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:06,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0037-1423781801505-soberoi-%5B95DCCA3AF1D34291A95ACE2D26CF8B1E%2F41F109A8F1E64F39-1423781826209-5-1-SUCCEEDED-root.soberoi-1423781805829.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:06,373 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0037_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:57:06,373 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:57:06,373 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0037 with final state: FINISHING
2015-02-12 14:57:06,373 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from RUNNING to FINAL_SAVING
2015-02-12 14:57:06,373 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0037
2015-02-12 14:57:06,374 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:57:06,374 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from FINAL_SAVING to FINISHING
2015-02-12 14:57:07,150 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:07,150 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 14:57:07,150 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000008
2015-02-12 14:57:07,150 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:57:07,150 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000008 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:57:07,379 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0037 unregistered successfully.
2015-02-12 14:57:07,383 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742232_1408 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50546
2015-02-12 14:57:07,383 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742233_1409 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:57:07,383 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742234_1410 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:57:07,383 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742235_1411 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:57:07,383 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742237_1413 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:57:07,384 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742238_1414 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:57:07,384 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742236_1412 127.0.0.1:50539 127.0.0.1:50546 127.0.0.1:50543
2015-02-12 14:57:07,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0037 dst=null perm=null proto=rpc
2015-02-12 14:57:07,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,425 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary
2015-02-12 14:57:07,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/_temporary dst=null perm=null proto=rpc
2015-02-12 14:57:07,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,440 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:07,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:07,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:07,461 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:07,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:07,463 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742232_1408, blk_1073742233_1409, blk_1073742234_1410, blk_1073742236_1412, blk_1073742237_1413, blk_1073742238_1414]
2015-02-12 14:57:07,464 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742232_1408, blk_1073742233_1409, blk_1073742235_1411, blk_1073742236_1412, blk_1073742237_1413, blk_1073742238_1414]
2015-02-12 14:57:07,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,481 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:57:07,482 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:57:07,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:07,510 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:57:07,510 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt"]
2015-02-12 14:57:07,510 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt"]
2015-02-12 14:57:07,510 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup"]
2015-02-12 14:57:07,510 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:57:07,511 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:57:07,511 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:57:07,512 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...roupinnernull-resultgroup
2015-02-12 14:57:07,521 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:07,916 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:07,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:07,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:07,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:07,922 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 38
2015-02-12 14:57:07,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038 dst=null perm=null proto=rpc
2015-02-12 14:57:07,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:57:07,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:57:07,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:07,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:07,929 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:07,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 src: /127.0.0.1:55050 dest: /127.0.0.1:50543
2015-02-12 14:57:07,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 src: /127.0.0.1:55051 dest: /127.0.0.1:50546
2015-02-12 14:57:07,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 src: /127.0.0.1:55052 dest: /127.0.0.1:50539
2015-02-12 14:57:07,937 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55052, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419, duration: 2325000
2015-02-12 14:57:07,937 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:07,937 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:07,938 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55051, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419, duration: 2765000
2015-02-12 14:57:07,938 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,938 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:07,938 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55050, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419, duration: 3611000
2015-02-12 14:57:07,939 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,940 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:07,941 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:07,942 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar
2015-02-12 14:57:07,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:07,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:07,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:07,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:07,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:07,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:57:07,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:57:07,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:57:07,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:57:07,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:57:07,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:07,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,951 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:07,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,955 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:07,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,957 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:07,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,959 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:07,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:07,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:07,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:07,963 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split
2015-02-12 14:57:07,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:07,965 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:57:07,966 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420 src: /127.0.0.1:55053 dest: /127.0.0.1:50549
2015-02-12 14:57:07,967 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420 src: /127.0.0.1:55054 dest: /127.0.0.1:50546
2015-02-12 14:57:07,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420 src: /127.0.0.1:55055 dest: /127.0.0.1:50539
2015-02-12 14:57:07,970 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420 src: /127.0.0.1:55056 dest: /127.0.0.1:50543
2015-02-12 14:57:07,973 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55056, dest: /127.0.0.1:50543, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, duration: 1611000
2015-02-12 14:57:07,973 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:07,973 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:07,973 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55055, dest: /127.0.0.1:50539, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, duration: 1820000
2015-02-12 14:57:07,974 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,974 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:07,974 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55054, dest: /127.0.0.1:50546, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, duration: 2586000
2015-02-12 14:57:07,975 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,975 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:07,975 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55053, dest: /127.0.0.1:50549, bytes: 1812, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, duration: 4063000
2015-02-12 14:57:07,976 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,977 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:07,978 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:07,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:07,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:07,983 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:57:07,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421 src: /127.0.0.1:55057 dest: /127.0.0.1:50546
2015-02-12 14:57:07,986 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421 src: /127.0.0.1:55058 dest: /127.0.0.1:50549
2015-02-12 14:57:07,987 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421 src: /127.0.0.1:55059 dest: /127.0.0.1:50543
2015-02-12 14:57:07,992 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55059, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421, duration: 1748000
2015-02-12 14:57:07,992 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:07,992 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:57:07,993 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55058, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421, duration: 2360000
2015-02-12 14:57:07,993 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,993 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:57:07,994 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55057, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421, duration: 3428000
2015-02-12 14:57:07,994 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:07,996 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]} size 0
2015-02-12 14:57:07,998 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:07,999 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:57:08,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:08,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:08,017 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:08,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422 src: /127.0.0.1:55060 dest: /127.0.0.1:50543
2015-02-12 14:57:08,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422 src: /127.0.0.1:55061 dest: /127.0.0.1:50546
2015-02-12 14:57:08,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422 src: /127.0.0.1:55062 dest: /127.0.0.1:50539
2015-02-12 14:57:08,024 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55062, dest: /127.0.0.1:50539, bytes: 98364, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422, duration: 1646000
2015-02-12 14:57:08,025 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:08,025 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:08,025 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55061, dest: /127.0.0.1:50546, bytes: 98364, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422, duration: 2156000
2015-02-12 14:57:08,025 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:08,026 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:08,026 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55060, dest: /127.0.0.1:50543, bytes: 98364, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422, duration: 2960000
2015-02-12 14:57:08,026 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:08,028 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:08,029 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:08,030 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0038
2015-02-12 14:57:08,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038 dst=null perm=null proto=rpc
2015-02-12 14:57:08,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:08,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:08,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:08,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:08,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:08,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:08,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,050 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 38 submitted by user soberoi
2015-02-12 14:57:08,050 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0038
2015-02-12 14:57:08,050 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0038
2015-02-12 14:57:08,051 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from NEW to NEW_SAVING
2015-02-12 14:57:08,051 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0038
2015-02-12 14:57:08,051 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:57:08,052 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0038 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:57:08,052 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from SUBMITTED to ACCEPTED
2015-02-12 14:57:08,052 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0038
2015-02-12 14:57:08,052 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0038_000001
2015-02-12 14:57:08,052 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from NEW to SUBMITTED
2015-02-12 14:57:08,053 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0038_000001 to scheduler from user: soberoi
2015-02-12 14:57:08,053 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:57:08,055 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0038/
2015-02-12 14:57:08,055 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0038
2015-02-12 14:57:08,055 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0038/
2015-02-12 14:57:08,154 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:08,155 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:08,155 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000001
2015-02-12 14:57:08,156 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 14:57:08,156 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0038_01_000001
2015-02-12 14:57:08,156 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:08,157 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0038_000001
2015-02-12 14:57:08,157 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0038 AttemptId: appattempt_1423780884992_0038_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0038_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:57:08,157 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:57:08,157 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:57:08,157 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0038_000001
2015-02-12 14:57:08,158 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0038_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0038_000001
2015-02-12 14:57:08,158 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0038_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:57:08,159 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0038_000001
2015-02-12 14:57:08,159 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0038_000001
2015-02-12 14:57:08,161 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:08,163 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000001 by user soberoi
2015-02-12 14:57:08,163 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0038
2015-02-12 14:57:08,163 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000001
2015-02-12 14:57:08,163 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from NEW to INITING
2015-02-12 14:57:08,163 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000001 to application application_1423780884992_0038
2015-02-12 14:57:08,164 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from INITING to RUNNING
2015-02-12 14:57:08,164 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0038_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0038_000001
2015-02-12 14:57:08,164 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:57:08,164 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:57:08,164 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:08,164 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:08,164 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:57:08,165 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:57:08,165 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:08,165 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0038_01_000001
2015-02-12 14:57:08,174 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0038_01_000001.tokens. Credentials list:
2015-02-12 14:57:08,224 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232 for deletion
2015-02-12 14:57:08,224 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233 for deletion
2015-02-12 14:57:08,224 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742235 for deletion
2015-02-12 14:57:08,224 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742236 for deletion
2015-02-12 14:57:08,225 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742237 for deletion
2015-02-12 14:57:08,225 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742238_1414 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742238 for deletion
2015-02-12 14:57:08,225 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232
2015-02-12 14:57:08,225 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742235
2015-02-12 14:57:08,225 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233
2015-02-12 14:57:08,226 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742237
2015-02-12 14:57:08,226 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742236
2015-02-12 14:57:08,226 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742238_1414 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742238
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232 for deletion
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233 for deletion
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742234 for deletion
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742236 for deletion
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742234
2015-02-12 14:57:08,280 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742237 for deletion
2015-02-12 14:57:08,281 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742236
2015-02-12 14:57:08,281 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742238_1414 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742238 for deletion
2015-02-12 14:57:08,281 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742237
2015-02-12 14:57:08,281 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742238_1414 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742238
2015-02-12 14:57:08,290 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:08,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0038_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000001.tokens
2015-02-12 14:57:08,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:08,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:08,573 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:08,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:08,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:08,633 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0038/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:08,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:08,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:08,700 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:08,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:08,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:08,778 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0038/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:08,778 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:08,814 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:08,814 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:08,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000001/default_container_executor.sh]
2015-02-12 14:57:09,159 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:09,159 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:09,625 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30004 milliseconds
2015-02-12 14:57:09,625 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 14:57:10,161 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:10,465 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742243_1419 to datanode(s) 127.0.0.1:50549
2015-02-12 14:57:10,465 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742232_1408, blk_1073742233_1409, blk_1073742234_1410, blk_1073742235_1411, blk_1073742238_1414]
2015-02-12 14:57:10,465 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742232_1408, blk_1073742233_1409, blk_1073742234_1410, blk_1073742235_1411, blk_1073742236_1412, blk_1073742237_1413]
2015-02-12 14:57:10,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:10,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:57:10,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:57:10,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:57:11,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038 dst=null perm=null proto=rpc
2015-02-12 14:57:11,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:57:11,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:57:11,162 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:11,282 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 to 127.0.0.1:50549
2015-02-12 14:57:11,284 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:57:11,284 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 src: /127.0.0.1:55083 dest: /127.0.0.1:50549
2015-02-12 14:57:11,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419 src: /127.0.0.1:55083 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:57:11,286 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742243_1419 size 254067
2015-02-12 14:57:11,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:11,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:11,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232 for deletion
2015-02-12 14:57:11,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233 for deletion
2015-02-12 14:57:11,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742234 for deletion
2015-02-12 14:57:11,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742235 for deletion
2015-02-12 14:57:11,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742236 for deletion
2015-02-12 14:57:11,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742237 for deletion
2015-02-12 14:57:11,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232
2015-02-12 14:57:11,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742234
2015-02-12 14:57:11,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742237
2015-02-12 14:57:11,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233
2015-02-12 14:57:11,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742235
2015-02-12 14:57:11,591 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742236
2015-02-12 14:57:11,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232 for deletion
2015-02-12 14:57:11,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233 for deletion
2015-02-12 14:57:11,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742234 for deletion
2015-02-12 14:57:11,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742235 for deletion
2015-02-12 14:57:11,860 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742238_1414 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742238 for deletion
2015-02-12 14:57:11,861 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742232_1408 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742232
2015-02-12 14:57:11,861 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742234
2015-02-12 14:57:11,861 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742233
2015-02-12 14:57:11,861 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742238_1414 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742238
2015-02-12 14:57:11,862 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742235
2015-02-12 14:57:12,166 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:12,430 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0037_01_000001 succeeded
2015-02-12 14:57:12,430 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:57:12,431 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0037_01_000001
2015-02-12 14:57:12,453 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000001
2015-02-12 14:57:12,453 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000001
2015-02-12 14:57:12,453 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000001
2015-02-12 14:57:12,454 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000001
2015-02-12 14:57:12,454 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0037_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:57:12,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0037/container_1423780884992_0037_01_000001
2015-02-12 14:57:12,454 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0037_01_000001 from application application_1423780884992_0037
2015-02-12 14:57:12,454 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:12,454 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0037
2015-02-12 14:57:12,607 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:12,609 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0038_000001
2015-02-12 14:57:12,609 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0038 APPATTEMPTID=appattempt_1423780884992_0038_000001
2015-02-12 14:57:12,609 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:57:12,609 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from ACCEPTED to RUNNING
2015-02-12 14:57:12,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:12,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:57:12,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:13,047 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:13,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423 src: /127.0.0.1:55090 dest: /127.0.0.1:50543
2015-02-12 14:57:13,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423 src: /127.0.0.1:55091 dest: /127.0.0.1:50546
2015-02-12 14:57:13,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423 src: /127.0.0.1:55092 dest: /127.0.0.1:50539
2015-02-12 14:57:13,146 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55092, dest: /127.0.0.1:50539, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423, duration: 39865000
2015-02-12 14:57:13,146 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:13,147 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:13,148 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55091, dest: /127.0.0.1:50546, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423, duration: 40347000
2015-02-12 14:57:13,148 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:13,149 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55090, dest: /127.0.0.1:50543, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423, duration: 42695000
2015-02-12 14:57:13,150 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:13,150 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:13,152 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:13,160 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:13,169 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0037_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:13,169 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0037_000001
2015-02-12 14:57:13,170 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0037_000001
2015-02-12 14:57:13,170 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0037_000001 State change from FINISHING to FINISHED
2015-02-12 14:57:13,170 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0037 State change from FINISHING to FINISHED
2015-02-12 14:57:13,170 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0037
2015-02-12 14:57:13,170 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0037_000001
2015-02-12 14:57:13,170 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0037,name=[95DCCA3AF1D34291A95ACE2D26CF8B1E/41F109A8F1E64F39985FDD2F1C830A37] lower*upper/(1/1) ...platform/cogroupinnernull,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0037/jobhistory/job/job_1423780884992_0037,appMasterHost=10.1.1.67,startTime=1423781801505,finishTime=1423781826373,finalStatus=SUCCEEDED
2015-02-12 14:57:13,170 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0037_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:57:13,171 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000001
2015-02-12 14:57:13,171 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0037_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:57:13,171 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0037_000001 released container container_1423780884992_0037_01_000001 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:57:13,171 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:13,171 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0037_000001 is done. finalState=FINISHED
2015-02-12 14:57:13,171 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0037 requests cleared
2015-02-12 14:57:13,173 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0037_000001 (auth:SIMPLE)
2015-02-12 14:57:13,175 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0037_01_000001
2015-02-12 14:57:13,175 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0037 CONTAINERID=container_1423780884992_0037_01_000001
2015-02-12 14:57:13,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0037_01_000001]
2015-02-12 14:57:13,175 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:13,175 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:13,175 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:13,176 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,177 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0037
2015-02-12 14:57:13,177 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:13,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,177 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0037, with delay of 10800 seconds
2015-02-12 14:57:13,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:13,204 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:57:13,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424 src: /127.0.0.1:55094 dest: /127.0.0.1:50539
2015-02-12 14:57:13,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424 src: /127.0.0.1:55095 dest: /127.0.0.1:50543
2015-02-12 14:57:13,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424 src: /127.0.0.1:55096 dest: /127.0.0.1:50546
2015-02-12 14:57:13,219 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55096, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424, duration: 1864000
2015-02-12 14:57:13,219 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:13,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:13,220 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55095, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424, duration: 2342000
2015-02-12 14:57:13,220 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:13,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:13,221 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55094, dest: /127.0.0.1:50539, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424, duration: 3327000
2015-02-12 14:57:13,222 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:13,223 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:13,228 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038.summary is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:13,437 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:13,437 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,438 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0037
2015-02-12 14:57:13,438 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:13,438 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0037, with delay of 10800 seconds
2015-02-12 14:57:13,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,541 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:13,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,543 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0037
2015-02-12 14:57:13,543 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,543 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,544 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,543 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:13,545 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0037, with delay of 10800 seconds
2015-02-12 14:57:13,635 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:13,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,636 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0037
2015-02-12 14:57:13,636 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:13,636 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0037, with delay of 10800 seconds
2015-02-12 14:57:13,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,637 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0037
2015-02-12 14:57:13,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419
2015-02-12 14:57:13,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420
2015-02-12 14:57:13,816 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415
2015-02-12 14:57:13,816 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416
2015-02-12 14:57:13,817 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417
2015-02-12 14:57:14,018 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422
2015-02-12 14:57:14,178 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:14,178 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:14,179 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000002
2015-02-12 14:57:14,179 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:57:14,256 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420
2015-02-12 14:57:14,442 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:14,442 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000003
2015-02-12 14:57:14,442 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:14,460 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419
2015-02-12 14:57:14,462 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418
2015-02-12 14:57:14,462 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416
2015-02-12 14:57:14,547 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:14,547 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000004
2015-02-12 14:57:14,547 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:14,638 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:14,638 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000005
2015-02-12 14:57:14,638 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:14,661 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422
2015-02-12 14:57:14,661 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421
2015-02-12 14:57:14,666 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0038_01_000002
2015-02-12 14:57:14,666 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:14,667 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0038_01_000003
2015-02-12 14:57:14,667 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:14,667 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0038_01_000004
2015-02-12 14:57:14,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:14,668 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0038_01_000005
2015-02-12 14:57:14,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:14,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:14,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:14,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:14,829 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:14,829 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:14,830 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:14,829 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:14,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000005 by user soberoi
2015-02-12 14:57:14,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000003 by user soberoi
2015-02-12 14:57:14,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0038
2015-02-12 14:57:14,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000002 by user soberoi
2015-02-12 14:57:14,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0038
2015-02-12 14:57:14,833 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000002
2015-02-12 14:57:14,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000004 by user soberoi
2015-02-12 14:57:14,834 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0038
2015-02-12 14:57:14,834 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from NEW to INITING
2015-02-12 14:57:14,834 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000003 to application application_1423780884992_0038
2015-02-12 14:57:14,834 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from INITING to RUNNING
2015-02-12 14:57:14,834 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000004
2015-02-12 14:57:14,833 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000003
2015-02-12 14:57:14,835 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from NEW to INITING
2015-02-12 14:57:14,836 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000004 to application application_1423780884992_0038
2015-02-12 14:57:14,836 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from INITING to RUNNING
2015-02-12 14:57:14,836 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:57:14,836 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,836 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,836 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:14,836 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0038
2015-02-12 14:57:14,837 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:14,833 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000005
2015-02-12 14:57:14,837 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:14,837 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0038_01_000004
2015-02-12 14:57:14,834 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:57:14,838 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,838 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,838 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:14,838 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0038
2015-02-12 14:57:14,838 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:14,838 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:14,839 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0038_01_000003
2015-02-12 14:57:14,834 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000002 to application application_1423780884992_0038
2015-02-12 14:57:14,839 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:57:14,839 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,839 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,839 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:14,839 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0038
2015-02-12 14:57:14,834 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from NEW to INITING
2015-02-12 14:57:14,840 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000005 to application application_1423780884992_0038
2015-02-12 14:57:14,840 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:14,840 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from INITING to RUNNING
2015-02-12 14:57:14,840 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:57:14,840 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,840 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0038
2015-02-12 14:57:14,840 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:14,841 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0038
2015-02-12 14:57:14,841 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:14,843 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:14,843 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0038_01_000005
2015-02-12 14:57:14,870 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0038_01_000004.tokens. Credentials list:
2015-02-12 14:57:14,872 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0038_01_000003.tokens. Credentials list:
2015-02-12 14:57:14,872 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0038_01_000005.tokens. Credentials list:
2015-02-12 14:57:14,886 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420
2015-02-12 14:57:14,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421
2015-02-12 14:57:14,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417
2015-02-12 14:57:14,954 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:14,954 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:15,088 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419
2015-02-12 14:57:15,089 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742246_1422
2015-02-12 14:57:15,102 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742241_1417
2015-02-12 14:57:15,103 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418
2015-02-12 14:57:15,104 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415
2015-02-12 14:57:15,104 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742245_1421
2015-02-12 14:57:15,105 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742244_1420
2015-02-12 14:57:15,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:15,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:15,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:15,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:15,187 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:15,187 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000006
2015-02-12 14:57:15,187 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:57:15,218 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000002/default_container_executor.sh]
2015-02-12 14:57:15,288 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742242_1418
2015-02-12 14:57:15,289 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742239_1415
2015-02-12 14:57:15,289 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742240_1416
2015-02-12 14:57:15,366 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0038_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000005.tokens
2015-02-12 14:57:15,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:15,397 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0038_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000003.tokens
2015-02-12 14:57:15,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:15,425 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0038_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000004.tokens
2015-02-12 14:57:15,425 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:15,443 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:15,547 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:15,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:15,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:15,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:15,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:15,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:15,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:15,638 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:15,681 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0038/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:15,687 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:15,696 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0038/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:15,705 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:15,707 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000006 by user soberoi
2015-02-12 14:57:15,707 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000006
2015-02-12 14:57:15,708 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000006 to application application_1423780884992_0038
2015-02-12 14:57:15,708 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:57:15,708 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:15,708 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0038
2015-02-12 14:57:15,708 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:15,708 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0038
2015-02-12 14:57:15,709 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:15,726 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:15,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:15,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:15,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:15,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:15,765 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:15,765 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:15,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:15,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:15,813 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0038/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:15,813 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:15,830 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0038/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:15,830 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:15,859 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:15,859 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:15,874 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:15,874 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:15,897 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:15,897 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:15,929 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:15,929 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:16,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000006/default_container_executor.sh]
2015-02-12 14:57:16,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000003/default_container_executor.sh]
2015-02-12 14:57:16,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000005/default_container_executor.sh]
2015-02-12 14:57:16,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000004/default_container_executor.sh]
2015-02-12 14:57:16,188 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:16,189 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0038
2015-02-12 14:57:16,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 14:57:16,190 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0038_01_000007 on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@6cb0c858
2015-02-12 14:57:16,448 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:16,448 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000008
2015-02-12 14:57:16,448 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:57:16,694 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:57:16,695 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:17,192 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0038_000001 on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096
2015-02-12 14:57:17,193 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0038 unreserved on node host: 10.1.1.67:50579 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:57:17,702 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000008 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:57:17,702 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000008 in state: RELEASED event:RELEASED
2015-02-12 14:57:17,702 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000008
2015-02-12 14:57:17,702 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:57:17,702 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000008 on node: host: 10.1.1.67:50571 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:57:18,454 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0038_01_000008
2015-02-12 14:57:19,024 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423
2015-02-12 14:57:19,024 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424
2015-02-12 14:57:19,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423
2015-02-12 14:57:19,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424
2015-02-12 14:57:20,112 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742243_1419
2015-02-12 14:57:20,297 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742248_1424
2015-02-12 14:57:20,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742247_1423
2015-02-12 14:57:24,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:24,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:24,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:24,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:24,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:25,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:25,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:25,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:25,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:25,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs-sparse.txt dst=null perm=null proto=rpc
2015-02-12 14:57:25,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:25,693 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:25,694 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000002
2015-02-12 14:57:25,695 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000002
2015-02-12 14:57:25,695 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:57:25,695 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000002
2015-02-12 14:57:25,717 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0038_01_000002 is : 143
2015-02-12 14:57:25,719 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:57:25,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425 src: /127.0.0.1:55133 dest: /127.0.0.1:50546
2015-02-12 14:57:25,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425 src: /127.0.0.1:55134 dest: /127.0.0.1:50539
2015-02-12 14:57:25,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425 src: /127.0.0.1:55135 dest: /127.0.0.1:50549
2015-02-12 14:57:25,730 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:25,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000002
2015-02-12 14:57:25,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000002
2015-02-12 14:57:25,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000002
2015-02-12 14:57:25,735 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000002
2015-02-12 14:57:25,735 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:25,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000002
2015-02-12 14:57:25,736 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000002 from application application_1423780884992_0038
2015-02-12 14:57:25,736 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:25,736 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:25,739 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist for DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:25,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:57:25,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:57:25,922 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:25,924 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000004
2015-02-12 14:57:25,924 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000004
2015-02-12 14:57:25,924 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:57:25,924 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000004
2015-02-12 14:57:25,946 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0038_01_000004 is : 143
2015-02-12 14:57:25,954 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:25,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000004
2015-02-12 14:57:25,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000004
2015-02-12 14:57:25,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000004
2015-02-12 14:57:25,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000004
2015-02-12 14:57:25,956 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000004
2015-02-12 14:57:25,956 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:25,956 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000004 from application application_1423780884992_0038
2015-02-12 14:57:25,957 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:25,957 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:26,028 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:26,031 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000003
2015-02-12 14:57:26,032 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000003
2015-02-12 14:57:26,033 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:57:26,033 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000003
2015-02-12 14:57:26,055 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0038_01_000003 is : 143
2015-02-12 14:57:26,065 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:26,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000003
2015-02-12 14:57:26,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000003
2015-02-12 14:57:26,066 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000003
2015-02-12 14:57:26,067 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000003
2015-02-12 14:57:26,067 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000003
2015-02-12 14:57:26,067 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:26,067 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000003 from application application_1423780884992_0038
2015-02-12 14:57:26,067 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:26,068 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:26,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:57:26,141 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:26,144 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000006
2015-02-12 14:57:26,144 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000006
2015-02-12 14:57:26,144 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:57:26,144 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000006
2015-02-12 14:57:26,145 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:26,145 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:57:26,145 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000002
2015-02-12 14:57:26,145 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:57:26,145 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000002 on node: host: 10.1.1.67:50579 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:57:26,169 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0038_01_000006 is : 143
2015-02-12 14:57:26,180 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:26,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000006
2015-02-12 14:57:26,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000006
2015-02-12 14:57:26,183 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000006
2015-02-12 14:57:26,184 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000006
2015-02-12 14:57:26,184 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000006
2015-02-12 14:57:26,184 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:26,184 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000006 from application application_1423780884992_0038
2015-02-12 14:57:26,184 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:26,184 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:26,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:57:26,308 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:26,310 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000005
2015-02-12 14:57:26,310 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000005
2015-02-12 14:57:26,310 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:57:26,310 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000005
2015-02-12 14:57:26,329 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0038_01_000005 is : 143
2015-02-12 14:57:26,337 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:26,338 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000005
2015-02-12 14:57:26,338 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000005
2015-02-12 14:57:26,338 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000005
2015-02-12 14:57:26,339 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000005
2015-02-12 14:57:26,340 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000005
2015-02-12 14:57:26,340 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:26,340 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000005 from application application_1423780884992_0038
2015-02-12 14:57:26,340 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:26,340 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:26,928 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:26,929 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:57:26,929 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000004
2015-02-12 14:57:26,929 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:26,929 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000004 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:26,929 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:26,929 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000009
2015-02-12 14:57:26,929 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0038_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:27,038 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:27,038 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:57:27,038 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000003
2015-02-12 14:57:27,038 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:27,039 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000003 on node: host: 10.1.1.67:50571 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:27,150 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:27,150 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:27,150 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:57:27,150 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000006
2015-02-12 14:57:27,151 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:57:27,151 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000006 on node: host: 10.1.1.67:50579 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:57:27,313 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:27,313 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:57:27,314 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000005
2015-02-12 14:57:27,314 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:27,314 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000005 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:27,753 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:27,762 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:27,764 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0038_01_000009 by user soberoi
2015-02-12 14:57:27,764 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000009
2015-02-12 14:57:27,764 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0038_01_000009 to application application_1423780884992_0038
2015-02-12 14:57:27,765 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 14:57:27,765 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0038
2015-02-12 14:57:27,765 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0038
2015-02-12 14:57:27,765 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:27,765 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0038
2015-02-12 14:57:27,766 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:27,792 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:27,793 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:27,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000009/default_container_executor.sh]
2015-02-12 14:57:27,933 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:27,933 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:28,039 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:28,155 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0038_01_000002]
2015-02-12 14:57:28,155 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:28,155 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:28,315 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:28,760 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:57:28,938 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0038_01_000004]
2015-02-12 14:57:28,938 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:29,040 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0038_01_000003]
2015-02-12 14:57:29,040 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:29,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0038_01_000006]
2015-02-12 14:57:29,159 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:29,319 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0038_01_000005]
2015-02-12 14:57:29,319 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:30,527 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:30,546 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:30,548 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:30,551 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:30,554 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:30,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:30,874 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:30,973 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426 src: /127.0.0.1:55150 dest: /127.0.0.1:50549
2015-02-12 14:57:30,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426 src: /127.0.0.1:55151 dest: /127.0.0.1:50539
2015-02-12 14:57:30,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426 src: /127.0.0.1:55152 dest: /127.0.0.1:50546
2015-02-12 14:57:31,021 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55152, dest: /127.0.0.1:50546, bytes: 150, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0038_r_000000_0_-420154647_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426, duration: 42579000
2015-02-12 14:57:31,021 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:31,022 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:57:31,022 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55151, dest: /127.0.0.1:50539, bytes: 150, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0038_r_000000_0_-420154647_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426, duration: 43507000
2015-02-12 14:57:31,022 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,023 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55150, dest: /127.0.0.1:50549, bytes: 150, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0038_r_000000_0_-420154647_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426, duration: 44531000
2015-02-12 14:57:31,023 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,023 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:31,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:31,035 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0038_r_000000_0_-420154647_1
2015-02-12 14:57:31,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:31,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:31,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/task_1423780884992_0038_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:57:31,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/_temporary/attempt_1423780884992_0038_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/task_1423780884992_0038_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:57:31,108 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:31,111 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000009
2015-02-12 14:57:31,111 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000009
2015-02-12 14:57:31,111 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000009 transitioned from RUNNING to KILLING
2015-02-12 14:57:31,111 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000009
2015-02-12 14:57:31,149 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0038_01_000009 is : 143
2015-02-12 14:57:31,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,152 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:57:31,158 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:31,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000009
2015-02-12 14:57:31,161 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000009
2015-02-12 14:57:31,162 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:31,162 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000009 from application application_1423780884992_0038
2015-02-12 14:57:31,162 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:31,162 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:31,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000009
2015-02-12 14:57:31,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000009
2015-02-12 14:57:31,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000009
2015-02-12 14:57:31,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:31,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:31,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/task_1423780884992_0038_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:57:31,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:31,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary/1/task_1423780884992_0038_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:57:31,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,202 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,206 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,228 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55135, dest: /127.0.0.1:50549, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425, duration: 5497320000
2015-02-12 14:57:31,228 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:31,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 16375
2015-02-12 14:57:31,240 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55134, dest: /127.0.0.1:50539, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425, duration: 5505485000
2015-02-12 14:57:31,240 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,244 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55133, dest: /127.0.0.1:50546, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425, duration: 5512865000
2015-02-12 14:57:31,244 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742249_1425, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,247 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,248 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742249_1425 size 69226
2015-02-12 14:57:31,249 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742249_1425 size 69226
2015-02-12 14:57:31,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,255 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:57:31,258 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427 src: /127.0.0.1:55154 dest: /127.0.0.1:50539
2015-02-12 14:57:31,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427 src: /127.0.0.1:55155 dest: /127.0.0.1:50549
2015-02-12 14:57:31,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427 src: /127.0.0.1:55156 dest: /127.0.0.1:50543
2015-02-12 14:57:31,267 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55156, dest: /127.0.0.1:50543, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427, duration: 1692000
2015-02-12 14:57:31,268 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:31,269 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:31,269 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55155, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427, duration: 2642000
2015-02-12 14:57:31,269 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,272 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55154, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427, duration: 5156000
2015-02-12 14:57:31,273 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,277 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:31,278 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:31,295 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:31,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:31,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:31,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:31,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:31,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:31,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,367 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]}
2015-02-12 14:57:31,369 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428 src: /127.0.0.1:55158 dest: /127.0.0.1:50549
2015-02-12 14:57:31,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428 src: /127.0.0.1:55159 dest: /127.0.0.1:50539
2015-02-12 14:57:31,372 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428 src: /127.0.0.1:55160 dest: /127.0.0.1:50543
2015-02-12 14:57:31,375 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55160, dest: /127.0.0.1:50543, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428, duration: 1868000
2015-02-12 14:57:31,375 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:31,376 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:57:31,376 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55159, dest: /127.0.0.1:50539, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428, duration: 2686000
2015-02-12 14:57:31,378 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,380 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:57:31,380 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55158, dest: /127.0.0.1:50549, bytes: 69226, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428, duration: 6355000
2015-02-12 14:57:31,380 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,380 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW]]} size 0
2015-02-12 14:57:31,383 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:31,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:31,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:31,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:31,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:31,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038/job_1423780884992_0038_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:31,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:31,417 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:57:31,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429 src: /127.0.0.1:55162 dest: /127.0.0.1:50543
2015-02-12 14:57:31,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429 src: /127.0.0.1:55163 dest: /127.0.0.1:50539
2015-02-12 14:57:31,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429 src: /127.0.0.1:55164 dest: /127.0.0.1:50549
2015-02-12 14:57:31,425 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55164, dest: /127.0.0.1:50549, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429, duration: 1830000
2015-02-12 14:57:31,426 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:31,426 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:57:31,427 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55163, dest: /127.0.0.1:50539, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429, duration: 2698000
2015-02-12 14:57:31,428 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,430 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:57:31,430 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55162, dest: /127.0.0.1:50543, bytes: 115079, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1668237719_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429, duration: 5874000
2015-02-12 14:57:31,430 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:31,431 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:31,433 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1668237719_1
2015-02-12 14:57:31,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:31,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:31,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:31,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0038-1423781828050-soberoi-%5BD8C3A9172988452894D5F1437393608E%2F2984200D5A6041A0-1423781851207-5-1-SUCCEEDED-root.soberoi-1423781832637.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:31,457 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0038_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:57:31,457 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:57:31,457 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0038 with final state: FINISHING
2015-02-12 14:57:31,457 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from RUNNING to FINAL_SAVING
2015-02-12 14:57:31,457 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0038
2015-02-12 14:57:31,458 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:57:31,458 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from FINAL_SAVING to FINISHING
2015-02-12 14:57:32,118 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:32,118 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 14:57:32,118 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000009
2015-02-12 14:57:32,118 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:32,118 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000009 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:32,465 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0038 unregistered successfully.
2015-02-12 14:57:32,469 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742243_1419 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:57:32,469 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742244_1420 127.0.0.1:50549 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50543
2015-02-12 14:57:32,469 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742245_1421 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:57:32,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742246_1422 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:57:32,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742248_1424 127.0.0.1:50539 127.0.0.1:50543 127.0.0.1:50546
2015-02-12 14:57:32,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742249_1425 127.0.0.1:50549 127.0.0.1:50539 127.0.0.1:50546
2015-02-12 14:57:32,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742247_1423 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539
2015-02-12 14:57:32,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0038 dst=null perm=null proto=rpc
2015-02-12 14:57:32,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,502 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary
2015-02-12 14:57:32,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/_temporary dst=null perm=null proto=rpc
2015-02-12 14:57:32,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,518 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:32,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:32,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,535 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:32,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:32,540 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup
2015-02-12 14:57:32,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup dst=null perm=null proto=rpc
2015-02-12 14:57:32,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:32,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull-resultgroup/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:32,550 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull
2015-02-12 14:57:32,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:32,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:32,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:32,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull dst=null perm=null proto=rpc
2015-02-12 14:57:32,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:32,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnernull/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:32,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,572 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:57:32,573 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:57:32,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:32,587 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:57:32,588 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:57:32,588 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt"]
2015-02-12 14:57:32,588 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle"]
2015-02-12 14:57:32,589 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:57:32,589 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-12 14:57:32,589 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-12 14:57:32,591 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...atform/cogroupinnersingle
2015-02-12 14:57:32,604 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:32,617 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:32,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:32,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:32,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:32,623 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 39
2015-02-12 14:57:32,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039 dst=null perm=null proto=rpc
2015-02-12 14:57:32,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:57:32,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:57:32,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,634 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:32,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 src: /127.0.0.1:55169 dest: /127.0.0.1:50543
2015-02-12 14:57:32,641 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 src: /127.0.0.1:55170 dest: /127.0.0.1:50546
2015-02-12 14:57:32,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 src: /127.0.0.1:55171 dest: /127.0.0.1:50539
2015-02-12 14:57:32,652 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55171, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430, duration: 3641000
2015-02-12 14:57:32,653 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:32,653 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:32,654 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55170, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430, duration: 4908000
2015-02-12 14:57:32,655 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,672 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55169, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430, duration: 7774000
2015-02-12 14:57:32,675 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,678 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,679 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,680 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:32,680 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar
2015-02-12 14:57:32,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:57:32,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:57:32,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:57:32,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:57:32,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:57:32,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,699 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:32,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,702 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:32,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,707 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:32,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,710 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:32,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:32,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,721 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split
2015-02-12 14:57:32,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:32,730 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:57:32,733 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431 src: /127.0.0.1:55172 dest: /127.0.0.1:50546
2015-02-12 14:57:32,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431 src: /127.0.0.1:55173 dest: /127.0.0.1:50549
2015-02-12 14:57:32,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431 src: /127.0.0.1:55174 dest: /127.0.0.1:50543
2015-02-12 14:57:32,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431 src: /127.0.0.1:55175 dest: /127.0.0.1:50539
2015-02-12 14:57:32,741 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55175, dest: /127.0.0.1:50539, bytes: 2167, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, duration: 1466000
2015-02-12 14:57:32,741 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:32,741 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:57:32,742 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55174, dest: /127.0.0.1:50543, bytes: 2167, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, duration: 2145000
2015-02-12 14:57:32,742 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,744 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55173, dest: /127.0.0.1:50549, bytes: 2167, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, duration: 4103000
2015-02-12 14:57:32,745 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,747 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55172, dest: /127.0.0.1:50546, bytes: 2167, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, duration: 7316000
2015-02-12 14:57:32,747 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:57:32,748 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,749 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:57:32,750 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,752 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:32,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,760 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:32,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432 src: /127.0.0.1:55176 dest: /127.0.0.1:50543
2015-02-12 14:57:32,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432 src: /127.0.0.1:55177 dest: /127.0.0.1:50549
2015-02-12 14:57:32,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432 src: /127.0.0.1:55178 dest: /127.0.0.1:50539
2015-02-12 14:57:32,770 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55178, dest: /127.0.0.1:50539, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432, duration: 1955000
2015-02-12 14:57:32,770 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:32,772 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55177, dest: /127.0.0.1:50549, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432, duration: 3480000
2015-02-12 14:57:32,773 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,774 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:32,791 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55176, dest: /127.0.0.1:50543, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432, duration: 19396000
2015-02-12 14:57:32,792 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,797 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,798 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,799 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:32,800 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:6
2015-02-12 14:57:32,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:32,811 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:32,813 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433 src: /127.0.0.1:55179 dest: /127.0.0.1:50546
2015-02-12 14:57:32,815 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433 src: /127.0.0.1:55180 dest: /127.0.0.1:50549
2015-02-12 14:57:32,820 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433 src: /127.0.0.1:55181 dest: /127.0.0.1:50539
2015-02-12 14:57:32,828 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55181, dest: /127.0.0.1:50539, bytes: 97569, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433, duration: 6211000
2015-02-12 14:57:32,829 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:32,832 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55180, dest: /127.0.0.1:50549, bytes: 97569, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433, duration: 9829000
2015-02-12 14:57:32,832 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,834 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,834 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55179, dest: /127.0.0.1:50546, bytes: 97569, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433, duration: 10630000
2015-02-12 14:57:32,834 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:32,836 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,836 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:32,838 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:32,838 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0039
2015-02-12 14:57:32,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039 dst=null perm=null proto=rpc
2015-02-12 14:57:32,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:32,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:32,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:32,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:32,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:32,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:32,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:32,857 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 39 submitted by user soberoi
2015-02-12 14:57:32,857 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0039
2015-02-12 14:57:32,857 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0039 State change from NEW to NEW_SAVING
2015-02-12 14:57:32,857 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0039
2015-02-12 14:57:32,858 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0039
2015-02-12 14:57:32,858 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0039 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:57:32,858 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0039 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:57:32,858 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0039 State change from SUBMITTED to ACCEPTED
2015-02-12 14:57:32,858 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0039_000001
2015-02-12 14:57:32,859 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from NEW to SUBMITTED
2015-02-12 14:57:32,859 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0039_000001 to scheduler from user: soberoi
2015-02-12 14:57:32,860 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:57:32,860 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0039
2015-02-12 14:57:32,866 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0039/
2015-02-12 14:57:32,866 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0039
2015-02-12 14:57:32,866 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0039/
2015-02-12 14:57:33,059 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:33,060 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000001
2015-02-12 14:57:33,060 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:57:33,060 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0039_01_000001
2015-02-12 14:57:33,060 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:33,060 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0039_000001
2015-02-12 14:57:33,061 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0039 AttemptId: appattempt_1423780884992_0039_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0039_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ]
2015-02-12 14:57:33,061 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:57:33,061 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:57:33,061 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0039_000001
2015-02-12 14:57:33,062 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0039_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0039_000001
2015-02-12 14:57:33,062 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0039_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:57:33,062 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0039_000001
2015-02-12 14:57:33,063 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0039_000001
2015-02-12 14:57:33,065 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:33,067 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000001 by user soberoi
2015-02-12 14:57:33,068 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0039
2015-02-12 14:57:33,068 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000001
2015-02-12 14:57:33,068 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from NEW to INITING
2015-02-12 14:57:33,068 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000001 to application application_1423780884992_0039
2015-02-12 14:57:33,068 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0039_01_000001, NodeId: 10.1.1.67:50571, NodeHttpAddress: 10.1.1.67:50574, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50571 }, ] for AM appattempt_1423780884992_0039_000001
2015-02-12 14:57:33,068 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from INITING to RUNNING
2015-02-12 14:57:33,069 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:57:33,069 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:57:33,069 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:33,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:33,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:57:33,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:57:33,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:33,070 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0039_01_000001
2015-02-12 14:57:33,081 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0039_01_000001.tokens. Credentials list:
2015-02-12 14:57:33,135 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:33,235 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:33,328 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423780884992_0039_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000001.tokens
2015-02-12 14:57:33,328 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039
2015-02-12 14:57:33,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:33,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:33,467 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0039/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:33,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:33,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:33,525 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:33,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:33,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:33,591 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0039/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:33,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:33,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:33,654 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0039/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:33,654 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:33,689 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:33,689 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:33,799 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000001/default_container_executor.sh]
2015-02-12 14:57:34,062 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:34,139 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:34,497 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50543 to replicate blk_1073742254_1430 to datanode(s) 127.0.0.1:50549
2015-02-12 14:57:34,498 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742243_1419, blk_1073742244_1420, blk_1073742245_1421, blk_1073742246_1422, blk_1073742247_1423, blk_1073742248_1424, blk_1073742249_1425]
2015-02-12 14:57:34,498 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742243_1419, blk_1073742244_1420, blk_1073742245_1421, blk_1073742249_1425]
2015-02-12 14:57:35,143 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:35,245 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=67a136b3-f1b1-484d-a4cc-f09c1babb01c, infoPort=50544, ipcPort=50545, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 to 127.0.0.1:50549
2015-02-12 14:57:35,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 src: /127.0.0.1:55186 dest: /127.0.0.1:50549
2015-02-12 14:57:35,247 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:57:35,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430 src: /127.0.0.1:55186 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:57:35,249 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742254_1430 size 254067
2015-02-12 14:57:35,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243 for deletion
2015-02-12 14:57:35,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244 for deletion
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742245_1421 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742245 for deletion
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742246_1422 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742246 for deletion
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742247_1423 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742247 for deletion
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742245_1421 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742245
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742247_1423 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742247
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742248 for deletion
2015-02-12 14:57:35,609 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742249 for deletion
2015-02-12 14:57:35,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742246_1422 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742246
2015-02-12 14:57:35,609 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742248
2015-02-12 14:57:35,609 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742249
2015-02-12 14:57:35,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243 for deletion
2015-02-12 14:57:35,875 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244 for deletion
2015-02-12 14:57:35,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742245_1421 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742245 for deletion
2015-02-12 14:57:35,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742249 for deletion
2015-02-12 14:57:35,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243
2015-02-12 14:57:35,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742245_1421 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742245
2015-02-12 14:57:35,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244
2015-02-12 14:57:35,876 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742249
2015-02-12 14:57:35,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:35,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:57:35,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:57:35,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:57:36,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039 dst=null perm=null proto=rpc
2015-02-12 14:57:36,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:57:36,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:57:36,144 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:36,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:36,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:37,149 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:37,499 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:37,502 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742243_1419, blk_1073742244_1420, blk_1073742245_1421, blk_1073742246_1422, blk_1073742247_1423, blk_1073742248_1424]
2015-02-12 14:57:37,503 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742243_1419, blk_1073742244_1420, blk_1073742246_1422, blk_1073742247_1423, blk_1073742248_1424, blk_1073742249_1425]
2015-02-12 14:57:37,505 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423780884992_0039_000001
2015-02-12 14:57:37,505 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi IP=10.1.1.67 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1423780884992_0039 APPATTEMPTID=appattempt_1423780884992_0039_000001
2015-02-12 14:57:37,506 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from LAUNCHED to RUNNING
2015-02-12 14:57:37,506 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0039 State change from ACCEPTED to RUNNING
2015-02-12 14:57:37,539 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0038_01_000001 succeeded
2015-02-12 14:57:37,539 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:57:37,539 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0038_01_000001
2015-02-12 14:57:37,563 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000001
2015-02-12 14:57:37,564 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000001
2015-02-12 14:57:37,564 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000001
2015-02-12 14:57:37,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0038/container_1423780884992_0038_01_000001
2015-02-12 14:57:37,567 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000001
2015-02-12 14:57:37,568 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0038_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:57:37,568 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0038_01_000001 from application application_1423780884992_0038
2015-02-12 14:57:37,568 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:37,569 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0038
2015-02-12 14:57:37,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:37,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:57:37,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:38,057 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1_conf.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:38,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434 src: /127.0.0.1:55194 dest: /127.0.0.1:50543
2015-02-12 14:57:38,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434 src: /127.0.0.1:55195 dest: /127.0.0.1:50549
2015-02-12 14:57:38,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434 src: /127.0.0.1:55196 dest: /127.0.0.1:50539
2015-02-12 14:57:38,150 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:38,152 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55196, dest: /127.0.0.1:50539, bytes: 114284, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434, duration: 38105000
2015-02-12 14:57:38,152 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:38,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:38,154 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55195, dest: /127.0.0.1:50549, bytes: 114284, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434, duration: 40124000
2015-02-12 14:57:38,154 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:38,156 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55194, dest: /127.0.0.1:50543, bytes: 114284, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434, duration: 42779000
2015-02-12 14:57:38,157 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:38,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:38,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]} size 0
2015-02-12 14:57:38,169 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:38,186 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0038_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:38,186 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0038_000001
2015-02-12 14:57:38,186 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0038_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:57:38,186 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423780884992_0038_000001
2015-02-12 14:57:38,186 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000001
2015-02-12 14:57:38,186 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0038_000001 State change from FINISHING to FINISHED
2015-02-12 14:57:38,186 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0038_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:38,186 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0038 State change from FINISHING to FINISHED
2015-02-12 14:57:38,186 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0038_000001 released container container_1423780884992_0038_01_000001 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:38,186 INFO amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423780884992_0038_000001
2015-02-12 14:57:38,187 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1423780884992_0038
2015-02-12 14:57:38,187 INFO fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423780884992_0038_000001 is done. finalState=FINISHED
2015-02-12 14:57:38,187 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423780884992_0038,name=[D8C3A9172988452894D5F1437393608E/2984200D5A6041A0B979C01B3C6AE12F] lower*upper/(1/1) ...roupinnernull-resultgroup,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:50569/proxy/application_1423780884992_0038/jobhistory/job/job_1423780884992_0038,appMasterHost=10.1.1.67,startTime=1423781828050,finishTime=1423781851457,finalStatus=SUCCEEDED
2015-02-12 14:57:38,187 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423780884992_0038 requests cleared
2015-02-12 14:57:38,189 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0038_000001 (auth:SIMPLE)
2015-02-12 14:57:38,193 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0038_01_000001
2015-02-12 14:57:38,194 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0038 CONTAINERID=container_1423780884992_0038_01_000001
2015-02-12 14:57:38,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0038_01_000001]
2015-02-12 14:57:38,194 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:38,195 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:38,195 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,196 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0038
2015-02-12 14:57:38,197 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:38,197 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0038, with delay of 10800 seconds
2015-02-12 14:57:38,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039.summary dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:38,212 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039.summary. BP-1595598241-10.1.1.67-1423780868362 blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:57:38,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435 src: /127.0.0.1:55198 dest: /127.0.0.1:50546
2015-02-12 14:57:38,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435 src: /127.0.0.1:55199 dest: /127.0.0.1:50543
2015-02-12 14:57:38,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435 src: /127.0.0.1:55200 dest: /127.0.0.1:50549
2015-02-12 14:57:38,220 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55200, dest: /127.0.0.1:50549, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435, duration: 1366000
2015-02-12 14:57:38,220 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:38,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:57:38,221 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55199, dest: /127.0.0.1:50543, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435, duration: 1938000
2015-02-12 14:57:38,221 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:38,222 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55198, dest: /127.0.0.1:50546, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435, duration: 3217000
2015-02-12 14:57:38,222 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:38,222 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:38,223 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:38,229 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039.summary is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:38,248 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243 for deletion
2015-02-12 14:57:38,248 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244 for deletion
2015-02-12 14:57:38,248 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742245_1421 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742245 for deletion
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742246_1422 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742246 for deletion
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742247_1423 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742247 for deletion
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742248 for deletion
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742246_1422 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742246
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742245_1421 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742245
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742248
2015-02-12 14:57:38,249 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742247_1423 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742247
2015-02-12 14:57:38,314 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243 for deletion
2015-02-12 14:57:38,314 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244 for deletion
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742246_1422 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742246 for deletion
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742247_1423 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742247 for deletion
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742243
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742244_1420 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742244
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742248 for deletion
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742249 for deletion
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742246_1422 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742246
2015-02-12 14:57:38,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742247_1423 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742247
2015-02-12 14:57:38,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742248
2015-02-12 14:57:38,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742249
2015-02-12 14:57:38,350 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:38,351 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,351 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,352 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0038
2015-02-12 14:57:38,352 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,352 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:38,352 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:38,353 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0038, with delay of 10800 seconds
2015-02-12 14:57:39,044 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429
2015-02-12 14:57:39,044 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432
2015-02-12 14:57:39,053 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427
2015-02-12 14:57:39,054 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433
2015-02-12 14:57:39,074 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:39,075 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:39,075 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000002
2015-02-12 14:57:39,075 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 14:57:39,075 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,076 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0038
2015-02-12 14:57:39,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,076 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:39,076 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0038, with delay of 10800 seconds
2015-02-12 14:57:39,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,154 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 14:57:39,154 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:39,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,154 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:39,155 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000003
2015-02-12 14:57:39,155 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,155 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0038
2015-02-12 14:57:39,155 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423780884992_0038
2015-02-12 14:57:39,155 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:39,156 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 14:57:39,157 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423780884992_0038, with delay of 10800 seconds
2015-02-12 14:57:39,199 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:39,200 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000004
2015-02-12 14:57:39,200 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:39,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430
2015-02-12 14:57:39,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426
2015-02-12 14:57:39,249 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431
2015-02-12 14:57:39,355 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:39,355 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000005
2015-02-12 14:57:39,355 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:39,449 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428
2015-02-12 14:57:39,630 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 14:57:39,631 INFO blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 14:57:39,661 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50571 for container : container_1423780884992_0039_01_000002
2015-02-12 14:57:39,661 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:39,661 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50583 for container : container_1423780884992_0039_01_000003
2015-02-12 14:57:39,662 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:39,662 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0039_01_000004
2015-02-12 14:57:39,662 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:39,663 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0039_01_000005
2015-02-12 14:57:39,663 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:39,689 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429
2015-02-12 14:57:39,689 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432
2015-02-12 14:57:39,690 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427
2015-02-12 14:57:39,691 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428
2015-02-12 14:57:39,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:39,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:39,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:39,827 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:39,827 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:39,827 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:39,827 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:39,831 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000002 by user soberoi
2015-02-12 14:57:39,831 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000002
2015-02-12 14:57:39,831 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000002 to application application_1423780884992_0039
2015-02-12 14:57:39,832 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 14:57:39,832 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,832 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,832 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:39,832 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000005 by user soberoi
2015-02-12 14:57:39,832 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0039
2015-02-12 14:57:39,832 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000005
2015-02-12 14:57:39,832 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:39,833 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:39,833 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from NEW to INITING
2015-02-12 14:57:39,834 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000005 to application application_1423780884992_0039
2015-02-12 14:57:39,833 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000003 by user soberoi
2015-02-12 14:57:39,834 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0039
2015-02-12 14:57:39,834 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000003
2015-02-12 14:57:39,832 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000004 by user soberoi
2015-02-12 14:57:39,835 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0039
2015-02-12 14:57:39,835 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000004
2015-02-12 14:57:39,836 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from NEW to INITING
2015-02-12 14:57:39,836 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000003 to application application_1423780884992_0039
2015-02-12 14:57:39,836 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from INITING to RUNNING
2015-02-12 14:57:39,837 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 14:57:39,837 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,837 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,837 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:39,837 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:39,837 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:39,837 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:39,838 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0039_01_000003
2015-02-12 14:57:39,834 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from INITING to RUNNING
2015-02-12 14:57:39,839 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 14:57:39,839 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,839 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,839 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:39,839 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:39,839 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:39,839 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:39,839 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0039_01_000005
2015-02-12 14:57:39,840 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from NEW to INITING
2015-02-12 14:57:39,840 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000004 to application application_1423780884992_0039
2015-02-12 14:57:39,840 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0039 transitioned from INITING to RUNNING
2015-02-12 14:57:39,840 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 14:57:39,840 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,840 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:39,840 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:39,840 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:39,840 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:39,841 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:39,841 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0039_01_000004
2015-02-12 14:57:39,866 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0039_01_000003.tokens. Credentials list:
2015-02-12 14:57:39,866 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0039_01_000004.tokens. Credentials list:
2015-02-12 14:57:39,866 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0039_01_000005.tokens. Credentials list:
2015-02-12 14:57:39,890 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430
2015-02-12 14:57:39,891 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431
2015-02-12 14:57:39,911 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:39,911 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:40,076 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:40,076 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:40,077 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000006
2015-02-12 14:57:40,077 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 14:57:40,104 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:40,104 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:40,105 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:40,135 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742252_1428
2015-02-12 14:57:40,136 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433
2015-02-12 14:57:40,137 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742251_1427
2015-02-12 14:57:40,138 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742253_1429
2015-02-12 14:57:40,140 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431
2015-02-12 14:57:40,140 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426
2015-02-12 14:57:40,141 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742256_1432
2015-02-12 14:57:40,154 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:40,155 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:40,156 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:40,156 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000007
2015-02-12 14:57:40,156 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:57:40,202 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:40,254 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000002/default_container_executor.sh]
2015-02-12 14:57:40,358 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:40,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0039_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000004.tokens
2015-02-12 14:57:40,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0039
2015-02-12 14:57:40,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423780884992_0039_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000005.tokens
2015-02-12 14:57:40,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0039
2015-02-12 14:57:40,394 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423780884992_0039_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000003.tokens
2015-02-12 14:57:40,394 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0039
2015-02-12 14:57:40,513 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430
2015-02-12 14:57:40,513 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742250_1426
2015-02-12 14:57:40,514 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742257_1433
2015-02-12 14:57:40,514 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742255_1431
2015-02-12 14:57:40,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:40,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:40,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:40,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:40,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:40,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:40,599 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0039/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:40,615 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:40,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:40,653 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0039/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:40,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:40,679 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:40,679 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:40,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:40,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:40,692 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:40,695 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:40,696 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000007 by user soberoi
2015-02-12 14:57:40,697 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000007
2015-02-12 14:57:40,697 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000007 to application application_1423780884992_0039
2015-02-12 14:57:40,697 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 14:57:40,697 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:40,698 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:40,698 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:40,698 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:40,698 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0039_01_000007
2015-02-12 14:57:40,704 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000006 by user soberoi
2015-02-12 14:57:40,705 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000006
2015-02-12 14:57:40,705 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000006 to application application_1423780884992_0039
2015-02-12 14:57:40,706 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 14:57:40,706 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:40,706 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:40,706 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:40,706 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:40,707 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:40,727 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0039_01_000007.tokens. Credentials list:
2015-02-12 14:57:40,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:40,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:40,794 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:40,794 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:40,797 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0039/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:40,797 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:40,807 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0039/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:40,807 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:40,807 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:40,845 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:40,845 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0039/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:57:40,871 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:40,871 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:40,874 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:40,874 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:40,887 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:40,887 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:40,909 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:40,909 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:41,077 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:41,077 INFO fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423780884992_0039
2015-02-12 14:57:41,077 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000008 Container Transitioned from NEW to RESERVED
2015-02-12 14:57:41,078 INFO fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423780884992_0039_01_000008 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@51fe22fe
2015-02-12 14:57:41,095 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000006/default_container_executor.sh]
2015-02-12 14:57:41,140 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000004/default_container_executor.sh]
2015-02-12 14:57:41,154 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000003/default_container_executor.sh]
2015-02-12 14:57:41,155 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:41,155 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:41,156 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000009
2015-02-12 14:57:41,156 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 14:57:41,171 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000007/default_container_executor.sh]
2015-02-12 14:57:41,206 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:41,206 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000010
2015-02-12 14:57:41,206 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 14:57:41,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000005/default_container_executor.sh]
2015-02-12 14:57:41,682 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:57:41,683 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:41,683 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:42,358 INFO fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423780884992_0039_000001 on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096
2015-02-12 14:57:42,358 INFO fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423780884992_0039 unreserved on node host: 10.1.1.67:50571 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 14:57:42,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:57:42,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423780884992_0039_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000007.tokens
2015-02-12 14:57:42,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039
2015-02-12 14:57:42,688 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:57:42,688 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000009 in state: RELEASED event:RELEASED
2015-02-12 14:57:42,688 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000009
2015-02-12 14:57:42,688 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 14:57:42,688 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000009 on node: host: 10.1.1.67:50583 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 14:57:42,688 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000010 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 14:57:42,688 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000010 in state: RELEASED event:RELEASED
2015-02-12 14:57:42,689 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi IP=10.1.1.67 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000010
2015-02-12 14:57:42,689 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:57:42,689 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000010 on node: host: 10.1.1.67:50579 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 14:57:43,362 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0039_01_000009
2015-02-12 14:57:43,362 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423780884992_0039_01_000010
2015-02-12 14:57:44,458 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434
2015-02-12 14:57:44,897 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434
2015-02-12 14:57:44,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435
2015-02-12 14:57:45,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435
2015-02-12 14:57:45,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742258_1434
2015-02-12 14:57:45,352 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742254_1430
2015-02-12 14:57:45,524 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742259_1435
2015-02-12 14:57:51,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:51,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:51,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:51,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:51,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:51,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:51,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:52,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:52,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:52,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:52,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower-offset.txt dst=null perm=null proto=rpc
2015-02-12 14:57:52,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:52,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_m_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:52,561 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:52,563 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000002
2015-02-12 14:57:52,563 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000002
2015-02-12 14:57:52,563 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000002 transitioned from RUNNING to KILLING
2015-02-12 14:57:52,564 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000002
2015-02-12 14:57:52,588 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000002 is : 143
2015-02-12 14:57:52,599 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist. BP-1595598241-10.1.1.67-1423780868362 blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW]]}
2015-02-12 14:57:52,601 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436 src: /127.0.0.1:55255 dest: /127.0.0.1:50546
2015-02-12 14:57:52,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436 src: /127.0.0.1:55256 dest: /127.0.0.1:50549
2015-02-12 14:57:52,609 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:52,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000002
2015-02-12 14:57:52,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000002
2015-02-12 14:57:52,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000002
2015-02-12 14:57:52,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000002
2015-02-12 14:57:52,610 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000002
2015-02-12 14:57:52,610 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:52,610 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000002 from application application_1423780884992_0039
2015-02-12 14:57:52,610 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:52,611 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:52,614 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436 src: /127.0.0.1:55257 dest: /127.0.0.1:50543
2015-02-12 14:57:52,625 INFO hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist for DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:52,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_m_000003_0 dst=null perm=null proto=rpc
2015-02-12 14:57:52,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_m_000001_0 dst=null perm=null proto=rpc
2015-02-12 14:57:52,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_m_000002_0 dst=null perm=null proto=rpc
2015-02-12 14:57:52,864 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:52,866 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000005
2015-02-12 14:57:52,866 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000005
2015-02-12 14:57:52,866 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000005 transitioned from RUNNING to KILLING
2015-02-12 14:57:52,866 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000005
2015-02-12 14:57:52,888 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000005 is : 143
2015-02-12 14:57:52,906 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:52,907 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:52,907 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000005
2015-02-12 14:57:52,908 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000003
2015-02-12 14:57:52,909 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000003
2015-02-12 14:57:52,909 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000003 transitioned from RUNNING to KILLING
2015-02-12 14:57:52,909 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000003
2015-02-12 14:57:52,910 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000005
2015-02-12 14:57:52,911 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000005
2015-02-12 14:57:52,914 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000005
2015-02-12 14:57:52,915 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000005
2015-02-12 14:57:52,917 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:52,918 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000005 from application application_1423780884992_0039
2015-02-12 14:57:52,918 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:52,918 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:52,928 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:52,931 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000003 is : 143
2015-02-12 14:57:52,932 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000004
2015-02-12 14:57:52,932 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000004
2015-02-12 14:57:52,932 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000004 transitioned from RUNNING to KILLING
2015-02-12 14:57:52,932 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000004
2015-02-12 14:57:52,949 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:52,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000003
2015-02-12 14:57:52,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000003
2015-02-12 14:57:52,953 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000003
2015-02-12 14:57:52,953 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000003
2015-02-12 14:57:52,954 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000003
2015-02-12 14:57:52,955 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:52,955 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000003 from application application_1423780884992_0039
2015-02-12 14:57:52,956 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:52,956 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:52,957 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000004 is : 143
2015-02-12 14:57:52,969 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:52,969 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000004
2015-02-12 14:57:52,971 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000004
2015-02-12 14:57:52,972 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000004
2015-02-12 14:57:52,974 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000004
2015-02-12 14:57:52,975 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000004
2015-02-12 14:57:52,976 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:52,976 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000004 from application application_1423780884992_0039
2015-02-12 14:57:52,976 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:52,976 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:52,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_m_000004_0 dst=null perm=null proto=rpc
2015-02-12 14:57:53,034 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:53,036 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000006
2015-02-12 14:57:53,036 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000006
2015-02-12 14:57:53,037 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:53,037 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000006 transitioned from RUNNING to KILLING
2015-02-12 14:57:53,037 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 14:57:53,038 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000006
2015-02-12 14:57:53,038 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000002
2015-02-12 14:57:53,038 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 14:57:53,038 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000002 on node: host: 10.1.1.67:50571 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 14:57:53,056 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000006 is : 143
2015-02-12 14:57:53,073 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:53,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000006
2015-02-12 14:57:53,075 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000006
2015-02-12 14:57:53,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000006
2015-02-12 14:57:53,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000006
2015-02-12 14:57:53,078 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000006
2015-02-12 14:57:53,078 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:53,079 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000006 from application application_1423780884992_0039
2015-02-12 14:57:53,079 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:53,079 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:53,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_m_000005_0 dst=null perm=null proto=rpc
2015-02-12 14:57:53,104 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:53,106 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000007
2015-02-12 14:57:53,107 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000007
2015-02-12 14:57:53,107 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:53,108 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 14:57:53,108 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000003
2015-02-12 14:57:53,108 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 14:57:53,108 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000003 on node: host: 10.1.1.67:50583 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 14:57:53,108 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000007 transitioned from RUNNING to KILLING
2015-02-12 14:57:53,108 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000007
2015-02-12 14:57:53,128 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000007 is : 143
2015-02-12 14:57:53,144 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:53,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000007
2015-02-12 14:57:53,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000007
2015-02-12 14:57:53,146 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000007
2015-02-12 14:57:53,148 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000007
2015-02-12 14:57:53,148 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000007
2015-02-12 14:57:53,150 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:53,151 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000007 from application application_1423780884992_0039
2015-02-12 14:57:53,151 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:53,151 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:53,871 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:53,871 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 14:57:53,871 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000005
2015-02-12 14:57:53,871 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:53,872 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000005 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:53,872 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:53,872 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000011
2015-02-12 14:57:53,872 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0039_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 14:57:53,936 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:53,936 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 14:57:53,936 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000004
2015-02-12 14:57:53,937 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50579, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:53,937 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000004 on node: host: 10.1.1.67:50579 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:54,041 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:54,042 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:54,042 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 14:57:54,042 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000006
2015-02-12 14:57:54,042 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50571, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 14:57:54,042 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000006 on node: host: 10.1.1.67:50571 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 14:57:54,109 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:54,110 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:54,110 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 14:57:54,110 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000007
2015-02-12 14:57:54,110 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50583, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:54,110 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000007 on node: host: 10.1.1.67:50583 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:54,742 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:54,753 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:54,755 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0039_01_000011 by user soberoi
2015-02-12 14:57:54,755 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000011
2015-02-12 14:57:54,755 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0039_01_000011 to application application_1423780884992_0039
2015-02-12 14:57:54,755 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000011 transitioned from NEW to LOCALIZING
2015-02-12 14:57:54,756 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0039
2015-02-12 14:57:54,756 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423780884992_0039
2015-02-12 14:57:54,756 INFO containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 14:57:54,756 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423780884992_0039
2015-02-12 14:57:54,756 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000011 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:57:54,787 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000011 transitioned from LOCALIZED to RUNNING
2015-02-12 14:57:54,787 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:54,875 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000011 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:57:54,875 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:54,909 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000011/default_container_executor.sh]
2015-02-12 14:57:54,940 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:55,042 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0039_01_000002]
2015-02-12 14:57:55,042 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:55,043 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:55,111 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0039_01_000003]
2015-02-12 14:57:55,111 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:55,111 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:55,747 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate...
2015-02-12 14:57:55,878 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0039_01_000005]
2015-02-12 14:57:55,878 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:55,942 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0039_01_000004]
2015-02-12 14:57:55,942 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:56,046 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0039_01_000006]
2015-02-12 14:57:56,047 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:56,114 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423780884992_0039_01_000007]
2015-02-12 14:57:56,115 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:57,434 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:57,443 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:57,445 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:57,446 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:57,451 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:57,454 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 14:57:57,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:57,740 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_r_000000_0/part-00000. BP-1595598241-10.1.1.67-1423780868362 blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:57:57,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437 src: /127.0.0.1:55272 dest: /127.0.0.1:50546
2015-02-12 14:57:57,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437 src: /127.0.0.1:55273 dest: /127.0.0.1:50543
2015-02-12 14:57:57,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437 src: /127.0.0.1:55274 dest: /127.0.0.1:50539
2015-02-12 14:57:57,882 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55274, dest: /127.0.0.1:50539, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0039_r_000000_0_-1504757383_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437, duration: 29942000
2015-02-12 14:57:57,882 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:57,882 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]} size 0
2015-02-12 14:57:57,883 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55273, dest: /127.0.0.1:50543, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0039_r_000000_0_-1504757383_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437, duration: 32270000
2015-02-12 14:57:57,884 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:57,885 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55272, dest: /127.0.0.1:50546, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1423780884992_0039_r_000000_0_-1504757383_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437, duration: 34312000
2015-02-12 14:57:57,886 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:57,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:57,888 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:57,893 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_r_000000_0/part-00000 is closed by DFSClient_attempt_1423780884992_0039_r_000000_0_-1504757383_1
2015-02-12 14:57:57,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:57,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_r_000000_0 dst=null perm=null proto=rpc
2015-02-12 14:57:57,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/task_1423780884992_0039_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:57:57,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/_temporary/attempt_1423780884992_0039_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/task_1423780884992_0039_r_000000 perm=soberoi:supergroup:rwxrwxrwx proto=rpc
2015-02-12 14:57:57,937 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0039_000001 (auth:SIMPLE)
2015-02-12 14:57:57,940 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423780884992_0039_01_000011
2015-02-12 14:57:57,941 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000011
2015-02-12 14:57:57,941 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000011 transitioned from RUNNING to KILLING
2015-02-12 14:57:57,941 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000011
2015-02-12 14:57:57,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:57,961 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:57,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1 dst=null perm=null proto=rpc
2015-02-12 14:57:57,982 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423780884992_0039_01_000011 is : 143
2015-02-12 14:57:57,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:57,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:57,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/task_1423780884992_0039_r_000000 dst=null perm=null proto=rpc
2015-02-12 14:57:57,996 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 14:57:57,998 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000011
2015-02-12 14:57:57,998 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 14:57:57,998 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000011 from application application_1423780884992_0039
2015-02-12 14:57:57,998 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:57:57,998 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:57:57,999 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000011
2015-02-12 14:57:58,000 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000011
2015-02-12 14:57:58,008 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000011
2015-02-12 14:57:58,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000011
2015-02-12 14:57:58,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:58,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary/1/task_1423780884992_0039_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/part-00000 perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:58,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary dst=null perm=null proto=rpc
2015-02-12 14:57:58,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:58,054 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:58,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:58,058 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:58,091 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55257, dest: /127.0.0.1:50543, bytes: 75511, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436, duration: 5473264000
2015-02-12 14:57:58,091 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:58,092 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:57:58,092 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55256, dest: /127.0.0.1:50549, bytes: 75511, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436, duration: 5472931000
2015-02-12 14:57:58,093 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,094 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:57:58,094 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55255, dest: /127.0.0.1:50546, bytes: 75511, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436, duration: 5476352000
2015-02-12 14:57:58,094 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742260_1436, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,095 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 17019
2015-02-12 14:57:58,096 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:58,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:58,106 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039.summary_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:58,108 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438 src: /127.0.0.1:55276 dest: /127.0.0.1:50549
2015-02-12 14:57:58,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438 src: /127.0.0.1:55277 dest: /127.0.0.1:50539
2015-02-12 14:57:58,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438 src: /127.0.0.1:55278 dest: /127.0.0.1:50546
2015-02-12 14:57:58,114 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55278, dest: /127.0.0.1:50546, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438, duration: 1425000
2015-02-12 14:57:58,115 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:58,116 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,117 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55277, dest: /127.0.0.1:50539, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438, duration: 3298000
2015-02-12 14:57:58,117 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,117 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,118 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55276, dest: /127.0.0.1:50549, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438, duration: 5116000
2015-02-12 14:57:58,118 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,118 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,120 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:58,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:58,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:58,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:58,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:58,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:58,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1.jhist dst=null perm=null proto=rpc
2015-02-12 14:57:58,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:58,153 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:58,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439 src: /127.0.0.1:55280 dest: /127.0.0.1:50543
2015-02-12 14:57:58,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439 src: /127.0.0.1:55281 dest: /127.0.0.1:50549
2015-02-12 14:57:58,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439 src: /127.0.0.1:55282 dest: /127.0.0.1:50539
2015-02-12 14:57:58,163 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55282, dest: /127.0.0.1:50539, bytes: 75511, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439, duration: 2427000
2015-02-12 14:57:58,163 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:58,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,164 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55281, dest: /127.0.0.1:50549, bytes: 75511, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439, duration: 3150000
2015-02-12 14:57:58,164 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,166 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,166 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55280, dest: /127.0.0.1:50543, bytes: 75511, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439, duration: 4837000
2015-02-12 14:57:58,167 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,169 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,172 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:58,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:58,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:58,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:58,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:58,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp dst=null perm=null proto=rpc
2015-02-12 14:57:58,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039/job_1423780884992_0039_1_conf.xml dst=null perm=null proto=rpc
2015-02-12 14:57:58,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw- proto=rpc
2015-02-12 14:57:58,208 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp. BP-1595598241-10.1.1.67-1423780868362 blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW]]}
2015-02-12 14:57:58,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440 src: /127.0.0.1:55283 dest: /127.0.0.1:50546
2015-02-12 14:57:58,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440 src: /127.0.0.1:55284 dest: /127.0.0.1:50549
2015-02-12 14:57:58,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440 src: /127.0.0.1:55285 dest: /127.0.0.1:50539
2015-02-12 14:57:58,216 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55285, dest: /127.0.0.1:50539, bytes: 114284, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440, duration: 1831000
2015-02-12 14:57:58,217 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:58,217 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,217 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55284, dest: /127.0.0.1:50549, bytes: 114284, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440, duration: 2539000
2015-02-12 14:57:58,217 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,218 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,218 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55283, dest: /127.0.0.1:50546, bytes: 114284, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1338733004_1, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440, duration: 3349000
2015-02-12 14:57:58,218 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:58,219 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:58,221 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1338733004_1
2015-02-12 14:57:58,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:58,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039.summary perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:58,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039_conf.xml perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:58,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423780884992_0039-1423781852857-soberoi-%5BD7923F78BB574AFD85CAF479B90CA1A0%2FD4A64547C57143A8-1423781878060-6-1-SUCCEEDED-root.soberoi-1423781857643.jhist perm=soberoi:supergroup:rwxrwx--- proto=rpc
2015-02-12 14:57:58,241 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423780884992_0039_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 14:57:58,241 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 14:57:58,242 INFO rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423780884992_0039 with final state: FINISHING
2015-02-12 14:57:58,242 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0039 State change from RUNNING to FINAL_SAVING
2015-02-12 14:57:58,242 INFO recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423780884992_0039
2015-02-12 14:57:58,243 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0039_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 14:57:58,243 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0039 State change from FINAL_SAVING to FINISHING
2015-02-12 14:57:58,946 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000011 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:57:58,947 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000011 in state: COMPLETED event:FINISHED
2015-02-12 14:57:58,947 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000011
2015-02-12 14:57:58,947 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:50575, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 14:57:58,947 INFO fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423780884992_0039_000001 released container container_1423780884992_0039_01_000011 on node: host: 10.1.1.67:50575 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 14:57:59,249 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423780884992_0039 unregistered successfully.
2015-02-12 14:57:59,252 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742254_1430 127.0.0.1:50543 127.0.0.1:50546 127.0.0.1:50539 127.0.0.1:50549
2015-02-12 14:57:59,252 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742255_1431 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543 127.0.0.1:50539
2015-02-12 14:57:59,252 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742256_1432 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:57:59,253 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742257_1433 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:57:59,253 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742259_1435 127.0.0.1:50546 127.0.0.1:50543 127.0.0.1:50549
2015-02-12 14:57:59,253 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742260_1436 127.0.0.1:50546 127.0.0.1:50549 127.0.0.1:50543
2015-02-12 14:57:59,254 INFO BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073742258_1434 127.0.0.1:50543 127.0.0.1:50549 127.0.0.1:50539
2015-02-12 14:57:59,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0039 dst=null perm=null proto=rpc
2015-02-12 14:57:59,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,313 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary
2015-02-12 14:57:59,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/_temporary dst=null perm=null proto=rpc
2015-02-12 14:57:59,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,328 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:59,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:59,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,353 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:59,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:59,357 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle
2015-02-12 14:57:59,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle dst=null perm=null proto=rpc
2015-02-12 14:57:59,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:59,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/cogroupinnersingle/part-00000 dst=null perm=null proto=rpc
2015-02-12 14:57:59,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:57:59,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:59,393 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 14:57:59,393 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 14:57:59,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/aftereverynodeclared dst=null perm=null proto=rpc
2015-02-12 14:57:59,425 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 14:57:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 14:57:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 14:57:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/cogroupfieldedpipesplatform/aftereverynodeclared"]
2015-02-12 14:57:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-02-12 14:57:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 3
2015-02-12 14:57:59,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 3
2015-02-12 14:57:59,427 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-02-12 14:57:59,427 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-02-12 14:57:59,450 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:59,460 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:59,470 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:59,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/430445280_upper_9FCF85CDC8054EE4A25B48B09F4CB2E7 dst=null perm=null proto=rpc
2015-02-12 14:57:59,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:59,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:59,479 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 40
2015-02-12 14:57:59,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040 dst=null perm=null proto=rpc
2015-02-12 14:57:59,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:57:59,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:57:59,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,487 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:50568
2015-02-12 14:57:59,488 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:59,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4339334034_lower_9B57F864AE6E47EDB85DC5C9F954AD58 dst=null perm=null proto=rpc
2015-02-12 14:57:59,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:59,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 src: /127.0.0.1:55290 dest: /127.0.0.1:50539
2015-02-12 14:57:59,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:57:59,491 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 41
2015-02-12 14:57:59,492 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 src: /127.0.0.1:55291 dest: /127.0.0.1:50543
2015-02-12 14:57:59,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041 dst=null perm=null proto=rpc
2015-02-12 14:57:59,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 src: /127.0.0.1:55292 dest: /127.0.0.1:50546
2015-02-12 14:57:59,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041 dst=null perm=soberoi:supergroup:rwxr-xr-x proto=rpc
2015-02-12 14:57:59,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041 dst=null perm=soberoi:supergroup:rwx------ proto=rpc
2015-02-12 14:57:59,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,500 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55292, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441, duration: 3684000
2015-02-12 14:57:59,500 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,501 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,501 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55291, dest: /127.0.0.1:50543, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441, duration: 4593000
2015-02-12 14:57:59,501 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,502 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,502 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55290, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441, duration: 6418000
2015-02-12 14:57:59,503 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,506 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,507 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar. BP-1595598241-10.1.1.67-1423780868362 blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:59,507 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,508 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar
2015-02-12 14:57:59,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 src: /127.0.0.1:55293 dest: /127.0.0.1:50539
2015-02-12 14:57:59,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 src: /127.0.0.1:55294 dest: /127.0.0.1:50549
2015-02-12 14:57:59,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 src: /127.0.0.1:55295 dest: /127.0.0.1:50546
2015-02-12 14:57:59,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:57:59,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:57:59,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:57:59,516 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55295, dest: /127.0.0.1:50546, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442, duration: 2033000
2015-02-12 14:57:59,517 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,518 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55294, dest: /127.0.0.1:50549, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442, duration: 3043000
2015-02-12 14:57:59,518 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,518 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:57:59,520 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55293, dest: /127.0.0.1:50539, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442, duration: 4929000
2015-02-12 14:57:59,520 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,521 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:57:59,523 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,523 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,525 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar
2015-02-12 14:57:59,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:59,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,527 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:59,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt dst=null perm=null proto=rpc
2015-02-12 14:57:59,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null proto=rpc
2015-02-12 14:57:59,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null proto=rpc
2015-02-12 14:57:59,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null proto=rpc
2015-02-12 14:57:59,532 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split
2015-02-12 14:57:59,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null proto=rpc
2015-02-12 14:57:59,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:59,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null proto=rpc
2015-02-12 14:57:59,534 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW]]}
2015-02-12 14:57:59,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:57:59,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443 src: /127.0.0.1:55296 dest: /127.0.0.1:50543
2015-02-12 14:57:59,538 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 14:57:59,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt dst=null perm=null proto=rpc
2015-02-12 14:57:59,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443 src: /127.0.0.1:55297 dest: /127.0.0.1:50549
2015-02-12 14:57:59,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,541 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443 src: /127.0.0.1:55298 dest: /127.0.0.1:50546
2015-02-12 14:57:59,543 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443 src: /127.0.0.1:55299 dest: /127.0.0.1:50539
2015-02-12 14:57:59,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,544 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split
2015-02-12 14:57:59,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:59,545 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split. BP-1595598241-10.1.1.67-1423780868362 blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]}
2015-02-12 14:57:59,546 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55299, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, duration: 1515000
2015-02-12 14:57:59,546 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,547 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55298, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, duration: 2182000
2015-02-12 14:57:59,548 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,548 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,549 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55297, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, duration: 3945000
2015-02-12 14:57:59,549 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444 src: /127.0.0.1:55300 dest: /127.0.0.1:50539
2015-02-12 14:57:59,549 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,551 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55296, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, duration: 5860000
2015-02-12 14:57:59,551 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,549 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,556 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,557 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444 src: /127.0.0.1:55301 dest: /127.0.0.1:50543
2015-02-12 14:57:59,557 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,558 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,559 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444 src: /127.0.0.1:55302 dest: /127.0.0.1:50546
2015-02-12 14:57:59,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444 src: /127.0.0.1:55303 dest: /127.0.0.1:50549
2015-02-12 14:57:59,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,563 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:57:59,564 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55303, dest: /127.0.0.1:50549, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, duration: 2003000
2015-02-12 14:57:59,565 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445 src: /127.0.0.1:55304 dest: /127.0.0.1:50539
2015-02-12 14:57:59,566 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55302, dest: /127.0.0.1:50546, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, duration: 2580000
2015-02-12 14:57:59,566 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,566 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,567 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55301, dest: /127.0.0.1:50543, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, duration: 4175000
2015-02-12 14:57:59,567 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,567 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445 src: /127.0.0.1:55305 dest: /127.0.0.1:50549
2015-02-12 14:57:59,568 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55300, dest: /127.0.0.1:50539, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, duration: 5206000
2015-02-12 14:57:59,568 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742268_1444, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,568 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445 src: /127.0.0.1:55306 dest: /127.0.0.1:50546
2015-02-12 14:57:59,571 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742268_1444 size 1787
2015-02-12 14:57:59,571 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,574 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55306, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445, duration: 1459000
2015-02-12 14:57:59,574 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,575 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55305, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445, duration: 2091000
2015-02-12 14:57:59,575 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,575 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,577 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55304, dest: /127.0.0.1:50539, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445, duration: 4292000
2015-02-12 14:57:59,577 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742269_1445, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,577 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,579 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,580 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo. BP-1595598241-10.1.1.67-1423780868362 blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|RBW]]}
2015-02-12 14:57:59,581 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,581 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:57:59,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446 src: /127.0.0.1:55307 dest: /127.0.0.1:50543
2015-02-12 14:57:59,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,584 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446 src: /127.0.0.1:55308 dest: /127.0.0.1:50549
2015-02-12 14:57:59,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,586 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446 src: /127.0.0.1:55309 dest: /127.0.0.1:50546
2015-02-12 14:57:59,591 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55309, dest: /127.0.0.1:50546, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446, duration: 1957000
2015-02-12 14:57:59,592 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,593 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,593 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55308, dest: /127.0.0.1:50549, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446, duration: 2471000
2015-02-12 14:57:59,593 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,594 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]}
2015-02-12 14:57:59,594 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,594 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55307, dest: /127.0.0.1:50543, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446, duration: 3938000
2015-02-12 14:57:59,595 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,595 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-51c1de92-0253-455c-bba7-ac03bcda9c17:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447 src: /127.0.0.1:55310 dest: /127.0.0.1:50543
2015-02-12 14:57:59,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447 src: /127.0.0.1:55311 dest: /127.0.0.1:50539
2015-02-12 14:57:59,601 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,601 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 14:57:59,602 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447 src: /127.0.0.1:55312 dest: /127.0.0.1:50549
2015-02-12 14:57:59,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml dst=null perm=soberoi:supergroup:rw-r--r-- proto=rpc
2015-02-12 14:57:59,607 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55312, dest: /127.0.0.1:50549, bytes: 96733, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 6b984cb2-71ab-460a-8cc1-517caf617de4, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447, duration: 2663000
2015-02-12 14:57:59,607 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,607 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,607 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55311, dest: /127.0.0.1:50539, bytes: 96733, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447, duration: 2219000
2015-02-12 14:57:59,608 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,608 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,608 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55310, dest: /127.0.0.1:50543, bytes: 96733, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447, duration: 3808000
2015-02-12 14:57:59,609 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,609 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-174017f2-c859-4e46-aa9a-7591a896afc4:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-088a0e47-cfbc-41e8-a3ca-b82340bd0397:NORMAL|RBW]]} size 0
2015-02-12 14:57:59,615 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,616 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0040
2015-02-12 14:57:59,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040 dst=null perm=null proto=rpc
2015-02-12 14:57:59,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:59,618 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml. BP-1595598241-10.1.1.67-1423780868362 blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4e0df8e-c520-4092-9aef-0a330e538dfb:NORMAL|RBW]]}
2015-02-12 14:57:59,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:59,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448 src: /127.0.0.1:55313 dest: /127.0.0.1:50539
2015-02-12 14:57:59,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448 src: /127.0.0.1:55314 dest: /127.0.0.1:50543
2015-02-12 14:57:59,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:59,623 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448 src: /127.0.0.1:55315 dest: /127.0.0.1:50546
2015-02-12 14:57:59,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:59,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:59,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:59,626 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55315, dest: /127.0.0.1:50546, bytes: 97006, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 3baae80f-cbbd-47e2-a819-a98ddd6106a2, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448, duration: 1650000
2015-02-12 14:57:59,627 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 14:57:59,628 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55314, dest: /127.0.0.1:50543, bytes: 97006, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: 67a136b3-f1b1-484d-a4cc-f09c1babb01c, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448, duration: 2922000
2015-02-12 14:57:59,628 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,629 INFO DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:55313, dest: /127.0.0.1:50539, bytes: 97006, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894720935_9, offset: 0, srvID: ba4eb4c8-687e-4153-8eed-0696bee7a7e5, blockid: BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448, duration: 4144000
2015-02-12 14:57:59,629 INFO datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 14:57:59,630 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50546 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,635 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-c3ea31e5-6252-4641-bdac-bc101c87c3f1:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,636 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50539 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d4a2b6f1-e5b4-49a9-9c33-b20870128ec3:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-4ecf951b-09c1-4993-81ac-c63adb2c3d35:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-c6c5584e-4881-4868-83c9-6613fcde082c:NORMAL|FINALIZED]]} size 0
2015-02-12 14:57:59,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,640 INFO hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml is closed by DFSClient_NONMAPREDUCE_-1894720935_9
2015-02-12 14:57:59,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,640 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423780884992_0041
2015-02-12 14:57:59,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041 dst=null perm=null proto=rpc
2015-02-12 14:57:59,643 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 40 submitted by user soberoi
2015-02-12 14:57:59,643 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0040
2015-02-12 14:57:59,643 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0040
2015-02-12 14:57:59,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:59,643 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0040
2015-02-12 14:57:59,643 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0040 State change from NEW to NEW_SAVING
2015-02-12 14:57:59,644 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0040 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:57:59,644 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0040 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 14:57:59,644 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0040 State change from SUBMITTED to ACCEPTED
2015-02-12 14:57:59,644 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0040_000001
2015-02-12 14:57:59,644 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0040_000001 State change from NEW to SUBMITTED
2015-02-12 14:57:59,645 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0040_000001 to scheduler from user: soberoi
2015-02-12 14:57:59,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml dst=null perm=null proto=rpc
2015-02-12 14:57:59,645 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0040_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:57:59,646 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0040
2015-02-12 14:57:59,647 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0040/
2015-02-12 14:57:59,647 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0040
2015-02-12 14:57:59,648 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0040/
2015-02-12 14:57:59,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:59,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=null proto=rpc
2015-02-12 14:57:59,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:59,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:57:59,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-2896389039007281802.jar dst=null perm=null proto=rpc
2015-02-12 14:57:59,663 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 41 submitted by user soberoi
2015-02-12 14:57:59,664 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423780884992_0041
2015-02-12 14:57:59,664 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi IP=10.1.1.67 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1423780884992_0041
2015-02-12 14:57:59,664 INFO recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423780884992_0041
2015-02-12 14:57:59,664 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0041 State change from NEW to NEW_SAVING
2015-02-12 14:57:59,664 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0041 State change from NEW_SAVING to SUBMITTED
2015-02-12 14:57:59,664 INFO fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423780884992_0041 from user: soberoi, in queue: default, currently num of applications: 3
2015-02-12 14:57:59,665 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423780884992_0041 State change from SUBMITTED to ACCEPTED
2015-02-12 14:57:59,665 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423780884992_0041
2015-02-12 14:57:59,665 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423780884992_0041_000001
2015-02-12 14:57:59,665 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0041_000001 State change from NEW to SUBMITTED
2015-02-12 14:57:59,665 INFO fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423780884992_0041_000001 to scheduler from user: soberoi
2015-02-12 14:57:59,669 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0041_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 14:57:59,671 INFO mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:50569/proxy/application_1423780884992_0041/
2015-02-12 14:57:59,671 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423780884992_0041
2015-02-12 14:57:59,671 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:50569/proxy/application_1423780884992_0041/
2015-02-12 14:57:59,949 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:57:59,951 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0040_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:59,951 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0040 CONTAINERID=container_1423780884992_0040_01_000001
2015-02-12 14:57:59,952 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0040_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50575, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:57:59,952 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50575 for container : container_1423780884992_0040_01_000001
2015-02-12 14:57:59,952 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0040_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:59,953 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0040_000001
2015-02-12 14:57:59,955 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0040 AttemptId: appattempt_1423780884992_0040_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0040_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ]
2015-02-12 14:57:59,956 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0040_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:57:59,956 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0040_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:57:59,956 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0040_000001
2015-02-12 14:57:59,957 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0040_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0040_000001
2015-02-12 14:57:59,957 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0040_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:57:59,957 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0040_000001
2015-02-12 14:57:59,957 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0040_000001
2015-02-12 14:57:59,959 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0040_000001 (auth:SIMPLE)
2015-02-12 14:57:59,961 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0040_01_000001 by user soberoi
2015-02-12 14:57:59,962 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0040
2015-02-12 14:57:59,962 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0040 CONTAINERID=container_1423780884992_0040_01_000001
2015-02-12 14:57:59,962 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0040 transitioned from NEW to INITING
2015-02-12 14:57:59,963 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0040_01_000001 to application application_1423780884992_0040
2015-02-12 14:57:59,965 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0040 transitioned from INITING to RUNNING
2015-02-12 14:57:59,965 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0040_01_000001, NodeId: 10.1.1.67:50575, NodeHttpAddress: 10.1.1.67:50578, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50575 }, ] for AM appattempt_1423780884992_0040_000001
2015-02-12 14:57:59,965 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0041_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 14:57:59,966 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0041 CONTAINERID=container_1423780884992_0041_01_000001
2015-02-12 14:57:59,965 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0040_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:57:59,966 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0040
2015-02-12 14:57:59,966 INFO scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423780884992_0041_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50579, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 14:57:59,966 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,966 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,966 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:50579 for container : container_1423780884992_0041_01_000001
2015-02-12 14:57:59,966 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,966 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0041_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 14:57:59,966 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,967 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423780884992_0041_000001
2015-02-12 14:57:59,967 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0040_01_000001
2015-02-12 14:57:59,967 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423780884992_0041 AttemptId: appattempt_1423780884992_0041_000001 MasterContainer: Container: [ContainerId: container_1423780884992_0041_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ]
2015-02-12 14:57:59,967 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0041_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 14:57:59,967 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0040_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:57:59,967 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0041_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 14:57:59,967 INFO amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423780884992_0041_000001
2015-02-12 14:57:59,970 INFO amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423780884992_0041_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0041_000001
2015-02-12 14:57:59,971 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423780884992_0041_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-02-12 14:57:59,971 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423780884992_0041_000001
2015-02-12 14:57:59,971 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423780884992_0041_000001
2015-02-12 14:57:59,973 INFO ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423780884992_0041_000001 (auth:SIMPLE)
2015-02-12 14:57:59,975 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423780884992_0041_01_000001 by user soberoi
2015-02-12 14:57:59,975 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423780884992_0041
2015-02-12 14:57:59,975 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.67 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1423780884992_0041 CONTAINERID=container_1423780884992_0041_01_000001
2015-02-12 14:57:59,975 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0041 transitioned from NEW to INITING
2015-02-12 14:57:59,976 INFO application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423780884992_0041_01_000001 to application application_1423780884992_0041
2015-02-12 14:57:59,976 INFO application.Application (ApplicationImpl.java:handle(458)) - Application application_1423780884992_0041 transitioned from INITING to RUNNING
2015-02-12 14:57:59,976 INFO amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423780884992_0041_01_000001, NodeId: 10.1.1.67:50579, NodeHttpAddress: 10.1.1.67:50582, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:50579 }, ] for AM appattempt_1423780884992_0041_000001
2015-02-12 14:57:59,976 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0041_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 14:57:59,976 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423780884992_0041
2015-02-12 14:57:59,976 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,976 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,977 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,977 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 14:57:59,977 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423780884992_0041_01_000001
2015-02-12 14:57:59,976 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423780884992_0041_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 14:57:59,981 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0040_01_000001.tokens. Credentials list:
2015-02-12 14:57:59,991 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0041_01_000001.tokens. Credentials list:
2015-02-12 14:58:00,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:58:00,138 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 14:58:00,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423780884992_0040_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0040/container_1423780884992_0040_01_000001.tokens
2015-02-12 14:58:00,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0040
2015-02-12 14:58:00,247 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423780884992_0041_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0041/container_1423780884992_0041_01_000001.tokens
2015-02-12 14:58:00,247 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0041
2015-02-12 14:58:00,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=null proto=rpc
2015-02-12 14:58:00,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=null proto=rpc
2015-02-12 14:58:00,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar dst=null perm=null proto=rpc
2015-02-12 14:58:00,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar dst=null perm=null proto=rpc
2015-02-12 14:58:00,404 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423780884992_0040/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,404 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0041/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:00,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:00,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:00,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:00,477 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423780884992_0041/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,477 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0040/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=null proto=rpc
2015-02-12 14:58:00,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split dst=null perm=null proto=rpc
2015-02-12 14:58:00,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=null proto=rpc
2015-02-12 14:58:00,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split dst=null perm=null proto=rpc
2015-02-12 14:58:00,560 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423780884992_0041/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,568 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423780884992_0040/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml dst=null perm=null proto=rpc
2015-02-12 14:58:00,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml dst=null perm=null proto=rpc
2015-02-12 14:58:00,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml dst=null perm=null proto=rpc
2015-02-12 14:58:00,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml dst=null perm=null proto=rpc
2015-02-12 14:58:00,665 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423780884992_0041/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,666 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0041_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:58:00,694 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:50538/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423780884992_0040/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 14:58:00,694 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0040_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 14:58:00,719 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0041_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:58:00,719 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:58:00,747 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0040_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 14:58:00,747 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:58:00,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423780884992_0041/container_1423780884992_0041_01_000001/default_container_executor.sh]
2015-02-12 14:58:00,900 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423780884992_0040/container_1423780884992_0040_01_000001/default_container_executor.sh]
2015-02-12 14:58:00,952 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0040_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:58:00,952 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:58:00,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0041_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 14:58:01,522 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50546 to replicate blk_1073742265_1441 to datanode(s) 127.0.0.1:50549
2015-02-12 14:58:01,523 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:50539 to replicate blk_1073742266_1442 to datanode(s) 127.0.0.1:50543
2015-02-12 14:58:01,523 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50549 to delete [blk_1073742256_1432, blk_1073742257_1433, blk_1073742258_1434, blk_1073742259_1435, blk_1073742260_1436, blk_1073742254_1430, blk_1073742255_1431]
2015-02-12 14:58:01,523 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50543 to delete [blk_1073742256_1432, blk_1073742258_1434, blk_1073742259_1435, blk_1073742260_1436, blk_1073742254_1430, blk_1073742255_1431]
2015-02-12 14:58:01,957 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:58:02,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742256 for deletion
2015-02-12 14:58:02,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742258 for deletion
2015-02-12 14:58:02,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742259_1435 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742259 for deletion
2015-02-12 14:58:02,266 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742260_1436 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742260 for deletion
2015-02-12 14:58:02,267 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742254 for deletion
2015-02-12 14:58:02,267 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742255 for deletion
2015-02-12 14:58:02,267 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742256
2015-02-12 14:58:02,268 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742259_1435 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742259
2015-02-12 14:58:02,268 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742258
2015-02-12 14:58:02,268 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742254
2015-02-12 14:58:02,268 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742260_1436 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742260
2015-02-12 14:58:02,268 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742255
2015-02-12 14:58:02,338 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=ba4eb4c8-687e-4153-8eed-0696bee7a7e5, infoPort=50540, ipcPort=50541, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 to 127.0.0.1:50543
2015-02-12 14:58:02,340 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 src: /127.0.0.1:55325 dest: /127.0.0.1:50543
2015-02-12 14:58:02,340 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 (numBytes=254067) to /127.0.0.1:50543
2015-02-12 14:58:02,343 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742266_1442 src: /127.0.0.1:55325 dest: /127.0.0.1:50543 of size 254067
2015-02-12 14:58:02,345 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50543 is added to blk_1073742266_1442 size 254067
2015-02-12 14:58:02,625 INFO datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3baae80f-cbbd-47e2-a819-a98ddd6106a2, infoPort=50547, ipcPort=50548, storageInfo=lv=-56;cid=testClusterID;nsid=307259344;c=0) Starting thread to transfer BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 to 127.0.0.1:50549
2015-02-12 14:58:02,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 src: /127.0.0.1:55326 dest: /127.0.0.1:50549
2015-02-12 14:58:02,627 INFO datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 (numBytes=254067) to /127.0.0.1:50549
2015-02-12 14:58:02,628 INFO datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-1595598241-10.1.1.67-1423780868362:blk_1073742265_1441 src: /127.0.0.1:55326 dest: /127.0.0.1:50549 of size 254067
2015-02-12 14:58:02,629 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50549 is added to blk_1073742265_1441 size 254067
2015-02-12 14:58:02,959 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:58:03,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742256 for deletion
2015-02-12 14:58:03,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742257 for deletion
2015-02-12 14:58:03,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742258 for deletion
2015-02-12 14:58:03,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742259_1435 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742259 for deletion
2015-02-12 14:58:03,377 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742256
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742257
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742259_1435 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742259
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742260_1436 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742260 for deletion
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742258
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742254 for deletion
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742255 for deletion
2015-02-12 14:58:03,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742260_1436 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742260
2015-02-12 14:58:03,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742255
2015-02-12 14:58:03,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-1595598241-10.1.1.67-1423780868362 blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-1595598241-10.1.1.67-1423780868362/current/finalized/subdir0/subdir1/blk_1073742254
2015-02-12 14:58:03,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:58:03,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null proto=rpc
2015-02-12 14:58:03,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:58:03,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:58:03,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:58:03,961 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:58:03,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/COMMIT_STARTED dst=null perm=null proto=rpc
2015-02-12 14:58:03,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/COMMIT_SUCCESS dst=null perm=null proto=rpc
2015-02-12 14:58:03,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/COMMIT_FAIL dst=null perm=null proto=rpc
2015-02-12 14:58:04,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040 dst=null perm=null proto=rpc
2015-02-12 14:58:04,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:58:04,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:58:04,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041 dst=null perm=null proto=rpc
2015-02-12 14:58:04,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null proto=rpc
2015-02-12 14:58:04,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null proto=rpc
2015-02-12 14:58:04,303 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423780884992_0039_01_000001 succeeded
2015-02-12 14:58:04,303 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 14:58:04,303 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423780884992_0039_01_000001
2015-02-12 14:58:04,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000001
2015-02-12 14:58:04,321 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000001
2015-02-12 14:58:04,321 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000001
2015-02-12 14:58:04,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423780884992_0039/container_1423780884992_0039_01_000001
2015-02-12 14:58:04,323 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000001
2015-02-12 14:58:04,323 INFO container.Container (ContainerImpl.java:handle(1010)) - Container container_1423780884992_0039_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 14:58:04,323 INFO application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423780884992_0039_01_000001 from application application_1423780884992_0039
2015-02-12 14:58:04,324 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 14:58:04,324 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423780884992_0039
2015-02-12 14:58:04,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742263_1439
2015-02-12 14:58:04,479 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742262_1438
2015-02-12 14:58:04,480 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742264_1440
2015-02-12 14:58:04,480 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437
2015-02-12 14:58:04,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:04,525 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50539 to delete [blk_1073742256_1432, blk_1073742257_1433, blk_1073742258_1434, blk_1073742254_1430, blk_1073742255_1431]
2015-02-12 14:58:04,525 INFO hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:50546 to delete [blk_1073742257_1433, blk_1073742259_1435, blk_1073742260_1436, blk_1073742254_1430, blk_1073742255_1431]
2015-02-12 14:58:04,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0040/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:04,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:04,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423780884992_0041/job.splitmetainfo dst=null perm=null proto=rpc
2015-02-12 14:58:04,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742271_1447
2015-02-12 14:58:04,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742270_1446
2015-02-12 14:58:04,915 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742267_1443
2015-02-12 14:58:04,915 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742261_1437
2015-02-12 14:58:04,916 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-1595598241-10.1.1.67-1423780868362:blk_1073742272_1448
2015-02-12 14:58:04,962 INFO fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 14:58:05,065 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423780884992_0039_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 14:58:05,065 INFO fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423780884992_0039_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 14:58:05,065 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423780884992_0039_000001
2015-02-12 14:58:05,065 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1423780884992_0039 CONTAINERID=container_1423780884992_0039_01_000001
2015-02-12 14:58:05,066 INFO scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423780884992_0039_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:50571, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8>